Aug 27 00:44:11 user nova-compute[73458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 27 00:44:14 user nova-compute[73458]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73458) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73458) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73458) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 00:44:14 user nova-compute[73458]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:44:14 user nova-compute[73458]: INFO nova.virt.driver [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 27 00:44:14 user nova-compute[73458]: INFO nova.compute.provider_config [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Acquiring lock "singleton_lock" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Acquired lock "singleton_lock" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Releasing lock "singleton_lock" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Full set of CONF: {{(pid=73458) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ******************************************************************************** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Configuration options gathered from: {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ================================================================================ {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] allow_resize_to_same_host      = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] arq_binding_timeout            = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] backdoor_port                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] backdoor_socket                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] block_device_allocate_retries  = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] block_device_allocate_retries_interval = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cert                           = self.pem {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute_monitors               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] config_dir                     = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] config_drive_format            = iso9660 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] config_source                  = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] console_host                   = user {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] control_exchange               = nova {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cpu_allocation_ratio           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] daemon                         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] debug                          = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_access_ip_network_name = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_availability_zone      = nova {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_ephemeral_format       = ext4 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_green_pool_size        = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] default_schedule_zone          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] disk_allocation_ratio          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] enable_new_services            = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] enabled_ssl_apis               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] flat_injected                  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] force_config_drive             = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] force_raw_images               = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] graceful_shutdown_timeout      = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] heal_instance_info_cache_interval = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] host                           = user {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_build_timeout         = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_delete_interval       = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_name_template         = instance-%08x {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_usage_audit           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_usage_audit_period    = month {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] internal_service_availability_zone = internal {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] key                            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] live_migration_retry_count     = 30 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_config_append              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_dir                        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_file                       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_options                    = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_rotate_interval            = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_rotate_interval_type       = days {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] log_rotation_type              = none {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] long_rpc_timeout               = 1800 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_concurrent_builds          = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_concurrent_live_migrations = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_concurrent_snapshots       = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_local_block_devices        = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_logfile_count              = 30 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] max_logfile_size_mb            = 200 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] maximum_instance_delete_attempts = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metadata_listen                = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metadata_listen_port           = 8775 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metadata_workers               = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] migrate_max_retries            = -1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] mkisofs_cmd                    = genisoimage {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] my_ip                          = 10.0.0.210 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] network_allocate_retries       = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] osapi_compute_listen_port      = 8774 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] osapi_compute_unique_server_name_scope =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] osapi_compute_workers          = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] password_length                = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] periodic_enable                = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] periodic_fuzzy_delay           = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] pointer_model                  = ps2mouse {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] preallocate_images             = none {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] publish_errors                 = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] pybasedir                      = /opt/stack/nova {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ram_allocation_ratio           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rate_limit_burst               = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rate_limit_except_level        = CRITICAL {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rate_limit_interval            = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reboot_timeout                 = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reclaim_instance_interval      = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] record                         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reimage_timeout_per_gb         = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] report_interval                = 120 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rescue_timeout                 = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reserved_host_cpus             = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reserved_host_disk_mb          = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reserved_host_memory_mb        = 512 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] reserved_huge_pages            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] resize_confirm_window          = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] resize_fs_using_block_device   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] resume_guests_state_on_host_boot = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rpc_response_timeout           = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] run_external_periodic_tasks    = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] running_deleted_instance_action = reap {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] running_deleted_instance_timeout = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler_instance_sync_interval = 120 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_down_time              = 720 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] servicegroup_driver            = db {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] shelved_offload_time           = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] shelved_poll_interval          = 3600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] shutdown_timeout               = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] source_is_ipv6                 = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ssl_only                       = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] state_path                     = /opt/stack/data/nova {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] sync_power_state_interval      = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] sync_power_state_pool_size     = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] syslog_log_facility            = LOG_USER {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] tempdir                        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] timeout_nbd                    = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] transport_url                  = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] update_resources_interval      = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_cow_images                 = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_eventlog                   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_journal                    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_json                       = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_rootwrap_daemon            = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_stderr                     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] use_syslog                     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vcpu_pin_set                   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plugging_is_fatal          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plugging_timeout           = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] virt_mkfs                      = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] volume_usage_poll_interval     = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] watch_log_file                 = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] web                            = /usr/share/spice-html5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_concurrency.disable_process_locking = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.auth_strategy              = keystone {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.compute_link_prefix        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.dhcp_domain                = novalocal {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.enable_instance_password   = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.glance_link_prefix         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.instance_list_per_project_cells = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.list_records_by_skipping_down_cells = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.local_metadata_per_cell    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.max_limit                  = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.metadata_cache_expiration  = 15 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.neutron_default_tenant_id  = default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.use_forwarded_for          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.use_neutron_default_nets   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_dynamic_targets = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_jsonfile_path   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.backend_argument         = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.config_prefix            = cache.oslo {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.dead_timeout             = 60.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.debug_cache_backend      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.enable_retry_client      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.enable_socket_keepalive  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.enabled                  = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.expiration_time          = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.hashclient_retry_attempts = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_dead_retry      = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_password        =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_sasl_enabled    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.memcache_username        =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.proxies                  = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.retry_attempts           = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.retry_delay              = 0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.socket_keepalive_count   = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.socket_keepalive_idle    = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.socket_keepalive_interval = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.tls_allowed_ciphers      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.tls_cafile               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.tls_certfile             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.tls_enabled              = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cache.tls_keyfile              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.auth_section            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.auth_type               = password {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.cafile                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.certfile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.collect_timing          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.cross_az_attach         = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.debug                   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.endpoint_template       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.http_retries            = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.insecure                = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.keyfile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.os_region_name          = RegionOne {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.split_loggers           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cinder.timeout                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.cpu_dedicated_set      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.cpu_shared_set         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.image_type_exclude_list = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.resource_provider_association_refresh = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.shutdown_retry_interval = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] conductor.workers              = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] console.allowed_origins        = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] console.ssl_ciphers            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] console.ssl_minimum_version    = default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] consoleauth.token_ttl          = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.cafile                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.certfile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.collect_timing          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.connect_retries         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.connect_retry_delay     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.endpoint_override       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.insecure                = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.keyfile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.max_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.min_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.region_name             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.service_name            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.service_type            = accelerator {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.split_loggers           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.status_code_retries     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.timeout                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] cyborg.version                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.backend               = sqlalchemy {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.connection            = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.connection_debug      = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.connection_parameters =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.connection_recycle_time = 3600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.connection_trace      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.db_inc_retry_interval = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.db_max_retries        = 20 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.db_max_retry_interval = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.db_retry_interval     = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.max_overflow          = 50 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.max_pool_size         = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.max_retries           = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.mysql_enable_ndb      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.mysql_wsrep_sync_wait = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.pool_timeout          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.retry_interval        = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.slave_connection      = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] database.sqlite_synchronous    = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.backend           = sqlalchemy {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.connection        = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.connection_debug  = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.connection_parameters =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.connection_recycle_time = 3600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.connection_trace  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.db_inc_retry_interval = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.db_max_retries    = 20 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.db_max_retry_interval = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.db_retry_interval = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.max_overflow      = 50 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.max_pool_size     = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.max_retries       = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.mysql_enable_ndb  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.pool_timeout      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.retry_interval    = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.slave_connection  = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] api_database.sqlite_synchronous = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] devices.enabled_mdev_types     = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ephemeral_storage_encryption.enabled = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.api_servers             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.cafile                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.certfile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.collect_timing          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.connect_retries         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.connect_retry_delay     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.debug                   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.default_trusted_certificate_ids = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.enable_certificate_validation = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.enable_rbd_download     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.endpoint_override       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.insecure                = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.keyfile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.max_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.min_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.num_retries             = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.rbd_ceph_conf           =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.rbd_connect_timeout     = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.rbd_pool                =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.rbd_user                =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.region_name             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.service_name            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.service_type            = image {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.split_loggers           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.status_code_retries     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.timeout                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.verify_glance_signatures = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] glance.version                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] guestfs.debug                  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.config_drive_cdrom      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.config_drive_inject_password = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.enable_remotefx         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.instances_path_share    =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.limit_cpu_features      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.use_multipath_io        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.vswitch_name            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] mks.enabled                    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.manager_interval   = 2400 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.precache_concurrency = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.remove_unused_base_images = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] image_cache.subdirectory_name  = _base {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.api_max_retries         = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.api_retry_interval      = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.auth_section            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.auth_type               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.cafile                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.certfile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.collect_timing          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.connect_retries         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.connect_retry_delay     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.endpoint_override       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.insecure                = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.keyfile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.max_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.min_version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.partition_key           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.peer_list               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.region_name             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.serial_console_state_timeout = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.service_name            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.service_type            = baremetal {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.split_loggers           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.status_code_retries     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.timeout                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ironic.version                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] key_manager.fixed_key          = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.barbican_api_version  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.barbican_endpoint     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.barbican_endpoint_type = public {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.barbican_region_name  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.cafile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.certfile              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.collect_timing        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.insecure              = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.keyfile               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.number_of_retries     = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.retry_delay           = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.send_service_user_token = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.split_loggers         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.timeout               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.verify_ssl            = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican.verify_ssl_path       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.auth_section = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.auth_type = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.cafile   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.certfile = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.collect_timing = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.insecure = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.keyfile  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.split_loggers = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] barbican_service_user.timeout  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.approle_role_id          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.approle_secret_id        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.cafile                   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.certfile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.collect_timing           = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.insecure                 = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.keyfile                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.kv_mountpoint            = secret {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.kv_version               = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.namespace                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.root_token_id            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.split_loggers            = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.ssl_ca_crt_file          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.timeout                  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.use_ssl                  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.cafile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.certfile              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.collect_timing        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.connect_retries       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.connect_retry_delay   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.endpoint_override     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.insecure              = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.keyfile               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.max_version           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.min_version           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.region_name           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.service_name          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.service_type          = identity {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.split_loggers         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.status_code_retries   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.timeout               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] keystone.version               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.connection_uri         =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_mode               = custom {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: WARNING oslo_config.cfg [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_power_governor_high = performance {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_power_management   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.device_detach_attempts = 8 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.device_detach_timeout  = 20 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.disk_cachemodes        = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.disk_prefix            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.enabled_perf_events    = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.file_backed_memory     = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.gid_maps               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.hw_disk_discard        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.hw_machine_type        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_rbd_pool        = rbd {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_type            = default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.images_volume_group    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.inject_key             = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.inject_partition       = -2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.inject_password        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.iscsi_iface            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.iser_use_multipath     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_downtime = 500 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_inbound_addr = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_scheme  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_timeout_action = abort {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_tunnelled = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: WARNING oslo_config.cfg [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 27 00:44:14 user nova-compute[73458]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 27 00:44:14 user nova-compute[73458]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 27 00:44:14 user nova-compute[73458]: and ``live_migration_inbound_addr`` respectively.
Aug 27 00:44:14 user nova-compute[73458]: ).  Its value may be silently ignored in the future.
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.live_migration_with_native_tls = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.max_queues             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.nfs_mount_options      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_pcie_ports         = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.pmem_namespaces        = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.quobyte_client_cfg     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rbd_secret_uuid        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rbd_user               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rescue_image_id        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rescue_kernel_id       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.rx_queue_size          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.smbfs_mount_options    =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.snapshot_compression   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.snapshot_image_format  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.sparse_logical_volumes = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.swtpm_enabled          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.swtpm_group            = tss {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.swtpm_user             = tss {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.sysinfo_serial         = unique {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.tb_cache_size          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.tx_queue_size          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.uid_maps               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.use_virtio_for_bridges = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.virt_type              = kvm {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.volume_clear           = zero {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.volume_clear_size      = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.volume_use_multipath   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_cache_path   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.auth_section           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.auth_type              = password {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.cafile                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.certfile               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.collect_timing         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.connect_retries        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.connect_retry_delay    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.default_floating_pool  = public {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.endpoint_override      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.extension_sync_interval = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.http_retries           = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.insecure               = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.keyfile                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.max_version            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.min_version            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.ovs_bridge             = br-int {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.physnets               = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.region_name            = RegionOne {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.service_metadata_proxy = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.service_name           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.service_type           = network {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.split_loggers          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.status_code_retries    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.timeout                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] neutron.version                = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] notifications.bdms_in_notifications = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] notifications.default_level    = INFO {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] notifications.notification_format = unversioned {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] notifications.notify_on_state_change = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] pci.alias                      = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] pci.device_spec                = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] pci.report_in_placement        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.auth_section         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.auth_type            = password {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.cafile               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.certfile             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.collect_timing       = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.connect_retries      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.connect_retry_delay  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.default_domain_id    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.default_domain_name  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.domain_id            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.domain_name          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.endpoint_override    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.insecure             = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.keyfile              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.max_version          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.min_version          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.password             = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.project_domain_id    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.project_domain_name  = Default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.project_id           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.project_name         = service {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.region_name          = RegionOne {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.service_name         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.service_type         = placement {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.split_loggers        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.status_code_retries  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.system_scope         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.timeout              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.trust_id             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.user_domain_id       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.user_domain_name     = Default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.user_id              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.username             = placement {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] placement.version              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.cores                    = 20 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.count_usage_from_placement = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.injected_file_content_bytes = 10240 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.injected_file_path_length = 255 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.injected_files           = 5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.instances                = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.key_pairs                = 100 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.metadata_items           = 128 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.ram                      = 51200 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.recheck_quota            = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.server_group_members     = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] quota.server_groups            = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rdp.enabled                    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.image_metadata_prefilter = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.max_attempts         = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.max_placement_results = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] scheduler.workers              = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.host_subset_size = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.isolated_hosts = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.isolated_images = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.pci_in_placement = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.track_instance_changes = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metrics.required               = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metrics.weight_multiplier      = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] metrics.weight_setting         = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.enabled         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.port_range      = 10000:20000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] serial_console.serialproxy_port = 6083 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.auth_section      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.auth_type         = password {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.cafile            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.certfile          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.collect_timing    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.insecure          = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.keyfile           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.send_service_user_token = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.split_loggers     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] service_user.timeout           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.agent_enabled            = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.enabled                  = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.html5proxy_port          = 6082 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.image_compression        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.jpeg_compression         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.playback_compression     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.server_listen            = 127.0.0.1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.streaming_mode           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] spice.zlib_compression         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] upgrade_levels.baseapi         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] upgrade_levels.cert            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] upgrade_levels.compute         = auto {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] upgrade_levels.conductor       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] upgrade_levels.scheduler       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.cafile = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.certfile = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.insecure = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vendordata_dynamic_auth.timeout = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.api_retry_count         = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.ca_file                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.cache_prefix            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.cluster_name            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.connection_pool_size    = 10 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.console_delay_seconds   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.datastore_regex         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.host_ip                 = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.host_password           = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.host_port               = 443 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.host_username           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.insecure                = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.integration_bridge      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.maximum_objects         = 100 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.pbm_default_policy      = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.pbm_enabled             = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.pbm_wsdl_location       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.serial_port_proxy_uri   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.serial_port_service_uri = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.task_poll_interval      = 0.5 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.use_linked_clone        = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.vnc_keymap              = en-us {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.vnc_port                = 5900 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vmware.vnc_port_total          = 10000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.auth_schemes               = ['none'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.enabled                    = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.novncproxy_port            = 6080 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.vencrypt_ca_certs          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.vencrypt_client_cert       = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vnc.vencrypt_client_key        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.disable_rootwrap   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.enable_numa_live_migration = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.libvirt_disable_apic = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.client_socket_timeout     = 900 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.default_pool_size         = 1000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.keep_alive                = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.max_header_line           = 16384 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.ssl_ca_file               = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.ssl_cert_file             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.ssl_key_file              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.tcp_keepidle              = 600 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] zvm.ca_file                    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] zvm.cloud_connector_url        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] zvm.reachable_timeout          = 300 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.enforce_new_defaults = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.enforce_scope      = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.policy_default_rule = default {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.connection_string     = messaging:// {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.enabled               = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.es_doc_type           = notification {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.es_scroll_size        = 10000 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.es_scroll_time        = 2m {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.filter_error_trace    = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.hmac_keys             = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.sentinel_service_name = mymaster {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.socket_timeout        = 0.1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.trace_requests        = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler.trace_sqlalchemy      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler_jaeger.process_tags   = {} {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler_jaeger.service_name_prefix = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] profiler_otlp.service_name_prefix = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] remote_debug.host              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] remote_debug.port              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_notifications.retry = -1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.auth_section        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.auth_type           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.cafile              = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.certfile            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.collect_timing      = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.connect_retries     = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.connect_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.endpoint_id         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.endpoint_override   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.insecure            = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.keyfile             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.max_version         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.min_version         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.region_name         = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.service_name        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.service_type        = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.split_loggers       = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.status_code_retries = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.status_code_retry_delay = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.timeout             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.valid_interfaces    = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_limit.version             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_reports.file_event_handler = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] oslo_reports.log_dir           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.group  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] vif_plug_ovs_privileged.user   = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.isolate_vif         = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] os_brick.lock_path             = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.capabilities   = [21] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.group          = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.helper_command = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] privsep_osbrick.user           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.group           = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.helper_command  = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] nova_sys_admin.user            = None {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG oslo_service.service [None req-7177a9f3-dc18-4490-b0a0-238370e15878 None None] ******************************************************************************** {{(pid=73458) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 27 00:44:14 user nova-compute[73458]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Starting native event thread {{(pid=73458) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Starting green dispatch thread {{(pid=73458) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Starting connection event dispatch thread {{(pid=73458) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Connecting to libvirt: qemu:///system {{(pid=73458) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1e992727d0> {{(pid=73458) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1e992727d0> {{(pid=73458) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 27 00:44:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Connection event '1' reason 'None'
Aug 27 00:44:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 00:44:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.mount [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Initialising _HostMountState generation 0 {{(pid=73458) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 27 00:44:22 user nova-compute[73458]: INFO nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host capabilities <capabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <host>
Aug 27 00:44:22 user nova-compute[73458]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 27 00:44:22 user nova-compute[73458]:     <cpu>
Aug 27 00:44:22 user nova-compute[73458]:       <arch>x86_64</arch>
Aug 27 00:44:22 user nova-compute[73458]:       <model>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <microcode version='1070'/>
Aug 27 00:44:22 user nova-compute[73458]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='osxsave'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='invtsc'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='rsba'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature name='skip-l1dfl-vmentry'/>
Aug 27 00:44:22 user nova-compute[73458]:       <pages unit='KiB' size='4'/>
Aug 27 00:44:22 user nova-compute[73458]:       <pages unit='KiB' size='2048'/>
Aug 27 00:44:22 user nova-compute[73458]:     </cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <power_management>
Aug 27 00:44:22 user nova-compute[73458]:       <suspend_mem/>
Aug 27 00:44:22 user nova-compute[73458]:       <suspend_disk/>
Aug 27 00:44:22 user nova-compute[73458]:       <suspend_hybrid/>
Aug 27 00:44:22 user nova-compute[73458]:     </power_management>
Aug 27 00:44:22 user nova-compute[73458]:     <iommu support='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <migration_features>
Aug 27 00:44:22 user nova-compute[73458]:       <live/>
Aug 27 00:44:22 user nova-compute[73458]:       <uri_transports>
Aug 27 00:44:22 user nova-compute[73458]:         <uri_transport>tcp</uri_transport>
Aug 27 00:44:22 user nova-compute[73458]:         <uri_transport>rdma</uri_transport>
Aug 27 00:44:22 user nova-compute[73458]:       </uri_transports>
Aug 27 00:44:22 user nova-compute[73458]:     </migration_features>
Aug 27 00:44:22 user nova-compute[73458]:     <topology>
Aug 27 00:44:22 user nova-compute[73458]:       <cells num='2'>
Aug 27 00:44:22 user nova-compute[73458]:         <cell id='0'>
Aug 27 00:44:22 user nova-compute[73458]:           <memory unit='KiB'>8140616</memory>
Aug 27 00:44:22 user nova-compute[73458]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 27 00:44:22 user nova-compute[73458]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 00:44:22 user nova-compute[73458]:           <distances>
Aug 27 00:44:22 user nova-compute[73458]:             <sibling id='0' value='10'/>
Aug 27 00:44:22 user nova-compute[73458]:             <sibling id='1' value='20'/>
Aug 27 00:44:22 user nova-compute[73458]:           </distances>
Aug 27 00:44:22 user nova-compute[73458]:           <cpus num='6'>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 27 00:44:22 user nova-compute[73458]:           </cpus>
Aug 27 00:44:22 user nova-compute[73458]:         </cell>
Aug 27 00:44:22 user nova-compute[73458]:         <cell id='1'>
Aug 27 00:44:22 user nova-compute[73458]:           <memory unit='KiB'>8255068</memory>
Aug 27 00:44:22 user nova-compute[73458]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 27 00:44:22 user nova-compute[73458]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 00:44:22 user nova-compute[73458]:           <distances>
Aug 27 00:44:22 user nova-compute[73458]:             <sibling id='0' value='20'/>
Aug 27 00:44:22 user nova-compute[73458]:             <sibling id='1' value='10'/>
Aug 27 00:44:22 user nova-compute[73458]:           </distances>
Aug 27 00:44:22 user nova-compute[73458]:           <cpus num='6'>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 27 00:44:22 user nova-compute[73458]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 27 00:44:22 user nova-compute[73458]:           </cpus>
Aug 27 00:44:22 user nova-compute[73458]:         </cell>
Aug 27 00:44:22 user nova-compute[73458]:       </cells>
Aug 27 00:44:22 user nova-compute[73458]:     </topology>
Aug 27 00:44:22 user nova-compute[73458]:     <cache>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 27 00:44:22 user nova-compute[73458]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 27 00:44:22 user nova-compute[73458]:     </cache>
Aug 27 00:44:22 user nova-compute[73458]:     <secmodel>
Aug 27 00:44:22 user nova-compute[73458]:       <model>apparmor</model>
Aug 27 00:44:22 user nova-compute[73458]:       <doi>0</doi>
Aug 27 00:44:22 user nova-compute[73458]:     </secmodel>
Aug 27 00:44:22 user nova-compute[73458]:     <secmodel>
Aug 27 00:44:22 user nova-compute[73458]:       <model>dac</model>
Aug 27 00:44:22 user nova-compute[73458]:       <doi>0</doi>
Aug 27 00:44:22 user nova-compute[73458]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 27 00:44:22 user nova-compute[73458]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 27 00:44:22 user nova-compute[73458]:     </secmodel>
Aug 27 00:44:22 user nova-compute[73458]:   </host>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='alpha'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>clipper</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='armv6l'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>spitz</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>nuri</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>kzm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>z2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>tosa</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n810</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>terrier</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>midway</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>microbit</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>verdex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>highbank</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>akita</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>connex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>collie</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='armv7l'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>spitz</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>nuri</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>kzm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>z2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>tosa</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n810</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>terrier</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>midway</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>microbit</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>verdex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>highbank</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>akita</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>connex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>collie</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='aarch64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>spitz</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>nuri</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>kzm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>z2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>tosa</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n810</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>n800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>terrier</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>midway</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>microbit</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>verdex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>raspi3b</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>highbank</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>akita</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>connex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>collie</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <acpi default='on' toggle='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='cris'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='i686'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>isapc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>microvm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='kvm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <pae/>
Aug 27 00:44:22 user nova-compute[73458]:       <nonpae/>
Aug 27 00:44:22 user nova-compute[73458]:       <acpi default='on' toggle='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:       <apic default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='m68k'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>an5206</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>q800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>next-cube</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='microblaze'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='microblazeel'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='mips'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>malta</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='mipsel'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>malta</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='mips64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>malta</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>pica61</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>magnum</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='mips64el'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>malta</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>pica61</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>magnum</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='16'>boston</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='ppc'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mac99</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>40p</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>taihu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='ppc64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>taihu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>40p</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mac99</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='ppc64le'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>taihu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>40p</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>mac99</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='riscv32'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='8'>spike</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>opentitan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='8'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='riscv64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='8'>spike</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>shakti_c</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='8'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='s390x'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='sh4'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>shix</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>r2d</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='sh4eb'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>shix</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>r2d</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='sparc'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>SS-5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>SS-20</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>LX</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>SS-4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>SS-10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>Voyager</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='sparc64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sun4u</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>niagara</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>sun4v</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='x86_64'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>64</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='1'>isapc</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>microvm</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='kvm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <acpi default='on' toggle='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:       <apic default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='xtensa'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>sim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>kc705</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ml605</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx200</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx60</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]:   <guest>
Aug 27 00:44:22 user nova-compute[73458]:     <os_type>hvm</os_type>
Aug 27 00:44:22 user nova-compute[73458]:     <arch name='xtensaeb'>
Aug 27 00:44:22 user nova-compute[73458]:       <wordsize>32</wordsize>
Aug 27 00:44:22 user nova-compute[73458]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='4'>sim</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>kc705</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ml605</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>virt</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx200</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>lx60</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 00:44:22 user nova-compute[73458]:       <domain type='qemu'/>
Aug 27 00:44:22 user nova-compute[73458]:     </arch>
Aug 27 00:44:22 user nova-compute[73458]:     <features>
Aug 27 00:44:22 user nova-compute[73458]:       <cpuselection/>
Aug 27 00:44:22 user nova-compute[73458]:       <deviceboot/>
Aug 27 00:44:22 user nova-compute[73458]:       <disksnapshot default='on' toggle='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     </features>
Aug 27 00:44:22 user nova-compute[73458]:   </guest>
Aug 27 00:44:22 user nova-compute[73458]: </capabilities>
Aug 27 00:44:22 user nova-compute[73458]: 
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-q35-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>i686</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='288'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'/>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='lm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-i440fx-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>i686</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='255'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'/>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='lm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ide</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-q35-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>i686</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='288'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'/>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='lm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-i440fx-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>i686</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='255'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'/>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='lm'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ide</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-q35-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>x86_64</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='288'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>efi</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='invtsc'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='rsba'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-i440fx-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>x86_64</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='255'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>efi</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='invtsc'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='rsba'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ide</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-q35-6.2</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>x86_64</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='288'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>efi</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='invtsc'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='rsba'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 27 00:44:22 user nova-compute[73458]: <domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 00:44:22 user nova-compute[73458]:   <domain>kvm</domain>
Aug 27 00:44:22 user nova-compute[73458]:   <machine>pc-i440fx-jammy</machine>
Aug 27 00:44:22 user nova-compute[73458]:   <arch>x86_64</arch>
Aug 27 00:44:22 user nova-compute[73458]:   <vcpu max='255'/>
Aug 27 00:44:22 user nova-compute[73458]:   <iothreads supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:   <os supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='firmware'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>efi</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:     <loader supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>rom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pflash</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='readonly'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>yes</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='secure'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>no</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </loader>
Aug 27 00:44:22 user nova-compute[73458]:   </os>
Aug 27 00:44:22 user nova-compute[73458]:   <cpu>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-passthrough' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='hostPassthroughMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='maximum' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='maximumMigratable'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>on</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>off</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='host-model' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <vendor>Intel</vendor>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ss'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='vmx'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pcid'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='hypervisor'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arat'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='umip'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='md-clear'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='invtsc'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibpb'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='ibrs'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-stibp'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='rsba'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='erms'/>
Aug 27 00:44:22 user nova-compute[73458]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:     <mode name='custom' supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>qemu64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>qemu32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>phenom</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>pentium</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>n270</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm64</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>kvm32</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>coreduo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>core2duo</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>athlon</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Westmere</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Snowridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Skylake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>SandyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Penryn</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G5</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G4</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G3</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Opteron_G2</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Opteron_G1</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>IvyBridge</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Icelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Haswell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Rome</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-Milan</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>EPYC</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Dhyana</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cooperlake</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>Conroe</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='no'>Broadwell</model>
Aug 27 00:44:22 user nova-compute[73458]:       <model usable='yes'>486</model>
Aug 27 00:44:22 user nova-compute[73458]:     </mode>
Aug 27 00:44:22 user nova-compute[73458]:   </cpu>
Aug 27 00:44:22 user nova-compute[73458]:   <memoryBacking supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:     <enum name='sourceType'>
Aug 27 00:44:22 user nova-compute[73458]:       <value>file</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>anonymous</value>
Aug 27 00:44:22 user nova-compute[73458]:       <value>memfd</value>
Aug 27 00:44:22 user nova-compute[73458]:     </enum>
Aug 27 00:44:22 user nova-compute[73458]:   </memoryBacking>
Aug 27 00:44:22 user nova-compute[73458]:   <devices>
Aug 27 00:44:22 user nova-compute[73458]:     <disk supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='diskDevice'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>disk</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cdrom</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>floppy</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>lun</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='bus'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ide</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>fdc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sata</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </disk>
Aug 27 00:44:22 user nova-compute[73458]:     <graphics supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='type'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>sdl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vnc</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>spice</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egl-headless</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </graphics>
Aug 27 00:44:22 user nova-compute[73458]:     <video supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='modelType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>cirrus</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>vmvga</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>qxl</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>none</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>bochs</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>ramfb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </video>
Aug 27 00:44:22 user nova-compute[73458]:     <hostdev supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='mode'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>subsystem</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='startupPolicy'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>default</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>mandatory</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>requisite</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>optional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='subsysType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>usb</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>pci</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>scsi</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='capsType'/>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='pciBackend'/>
Aug 27 00:44:22 user nova-compute[73458]:     </hostdev>
Aug 27 00:44:22 user nova-compute[73458]:     <rng supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtio-non-transitional</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>random</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>egd</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>builtin</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </rng>
Aug 27 00:44:22 user nova-compute[73458]:     <filesystem supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='driverType'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>path</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>handle</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>virtiofs</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </filesystem>
Aug 27 00:44:22 user nova-compute[73458]:     <tpm supported='yes'>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='model'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-tis</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>tpm-crb</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:       <enum name='backendModel'>
Aug 27 00:44:22 user nova-compute[73458]:         <value>passthrough</value>
Aug 27 00:44:22 user nova-compute[73458]:         <value>emulator</value>
Aug 27 00:44:22 user nova-compute[73458]:       </enum>
Aug 27 00:44:22 user nova-compute[73458]:     </tpm>
Aug 27 00:44:22 user nova-compute[73458]:   </devices>
Aug 27 00:44:22 user nova-compute[73458]:   <features>
Aug 27 00:44:22 user nova-compute[73458]:     <gic supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:     <vmcoreinfo supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <genid supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backingStoreInput supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <backup supported='yes'/>
Aug 27 00:44:22 user nova-compute[73458]:     <sev supported='no'/>
Aug 27 00:44:22 user nova-compute[73458]:   </features>
Aug 27 00:44:22 user nova-compute[73458]: </domainCapabilities>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73458) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73458) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Checking secure boot support for host arch (x86_64) {{(pid=73458) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 00:44:22 user nova-compute[73458]: INFO nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Secure Boot support detected
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] cpu compare xml: <cpu match="exact">
Aug 27 00:44:22 user nova-compute[73458]:   <model>Nehalem</model>
Aug 27 00:44:22 user nova-compute[73458]: </cpu>
Aug 27 00:44:22 user nova-compute[73458]:  {{(pid=73458) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 27 00:44:22 user nova-compute[73458]: INFO nova.virt.node [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Generated node identity 3dbe5db4-8c3d-4097-8fbe-32da614b3f79
Aug 27 00:44:22 user nova-compute[73458]: INFO nova.virt.node [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Wrote node identity 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 to /opt/stack/data/nova/compute_id
Aug 27 00:44:22 user nova-compute[73458]: WARNING nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Compute nodes ['3dbe5db4-8c3d-4097-8fbe-32da614b3f79'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 27 00:44:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 27 00:44:22 user nova-compute[73458]: WARNING nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 00:44:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:44:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:44:23 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:44:23 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Hypervisor/Node resource view: name=user free_ram=10867MB free_disk=26.369461059570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:44:23 user nova-compute[73458]: WARNING nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] No compute node record for user:3dbe5db4-8c3d-4097-8fbe-32da614b3f79: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 could not be found.
Aug 27 00:44:23 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Compute node record created for user:user with uuid: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:44:23 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [req-5815ecde-42cb-4d9e-9e76-3656d9f593be] Created resource provider record via placement API for resource provider with UUID 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 and name user.
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73458) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 27 00:44:23 user nova-compute[73458]: INFO nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] kernel doesn't support AMD SEV
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Libvirt baseline CPU <cpu>
Aug 27 00:44:23 user nova-compute[73458]:   <arch>x86_64</arch>
Aug 27 00:44:23 user nova-compute[73458]:   <model>Nehalem</model>
Aug 27 00:44:23 user nova-compute[73458]:   <vendor>Intel</vendor>
Aug 27 00:44:23 user nova-compute[73458]:   <topology sockets="6" cores="1" threads="1"/>
Aug 27 00:44:23 user nova-compute[73458]: </cpu>
Aug 27 00:44:23 user nova-compute[73458]:  {{(pid=73458) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Updated inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Updating resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 generation from 0 to 1 during operation: update_inventory {{(pid=73458) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Updating resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 generation from 1 to 2 during operation: update_traits {{(pid=73458) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.service [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Creating RPC server for service compute {{(pid=73458) start /opt/stack/nova/nova/service.py:182}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.service [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Join ServiceGroup membership for this service compute {{(pid=73458) start /opt/stack/nova/nova/service.py:199}}
Aug 27 00:44:23 user nova-compute[73458]: DEBUG nova.servicegroup.drivers.db [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73458) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 27 00:44:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:44:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:45:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:45:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=10279MB free_disk=26.273170471191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:46:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:46:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=10216MB free_disk=26.319793701171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:46:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:46:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:47:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:47:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=10194MB free_disk=26.103485107421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:47:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:48:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:48:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:48:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:48:18 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:18 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=9445MB free_disk=26.126224517822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:48:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:48:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:48:29 user nova-compute[73458]: INFO nova.compute.claims [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Claim successful on node user
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:48:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:48:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Creating image(s)
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "/opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "/opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:30 user nova-compute[73458]: DEBUG nova.policy [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0df48c36952f4b4581209d4cde322dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad18e0f41df146e382f6524daa86a75d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:48:31 user nova-compute[73458]: INFO nova.compute.claims [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Claim successful on node user
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.part --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.virt.images [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] 8d38b8b6-6075-47a6-bfce-08caf5b910c3 was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.part /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.part /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.converted" returned: 0 in 0.307s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:48:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.861s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:31 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp93_hdewq/privsep.sock']
Aug 27 00:48:31 user sudo[82684]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp93_hdewq/privsep.sock
Aug 27 00:48:31 user sudo[82684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:48:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Creating image(s)
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "/opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "/opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:31 user nova-compute[73458]: DEBUG nova.policy [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24e9f78541bc45c48b4e0637f666e9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6f575c140547d2ae48ed7dea334375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:48:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Successfully created port: c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:48:33 user sudo[82684]: pam_unix(sudo:session): session closed for user root
Aug 27 00:48:33 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Spawned new privsep daemon via rootwrap
Aug 27 00:48:33 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 00:48:33 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 00:48:33 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 27 00:48:33 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82710
Aug 27 00:48:33 user nova-compute[73458]: WARNING oslo_privsep.priv_context [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] privsep daemon already running
Aug 27 00:48:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Successfully created port: 6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk 1073741824" returned: 0 in 0.042s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.218s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk 1073741824" returned: 0 in 0.052s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Cannot resize image /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Ensure instance console log exists: /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Cannot resize image /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Ensure instance console log exists: /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:48:34 user nova-compute[73458]: INFO nova.compute.claims [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Claim successful on node user
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:48:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:48:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Creating image(s)
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG nova.policy [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01ccff6ef49a4362a6576ccf9cbbf552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580bff8187b74188bf3d77bb1413ba5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.245s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk 1073741824" returned: 0 in 0.043s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Successfully updated port: 6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquired lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.156s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Cannot resize image /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Ensure instance console log exists: /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-changed-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Refreshing instance network info cache due to event network-changed-6fef02f1-8592-4b68-ac49-03ee0e1f721e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:48:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] Acquiring lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Releasing lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Instance network_info: |[{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] Acquired lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Refreshing network info cache for port 6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Start _get_guest_xml network_info=[{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:48:37 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:37 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1627516867',display_name='tempest-ServersNegativeTestJSON-server-1627516867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1627516867',id=2,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-1ts7k3dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:32Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=9f140de9-a7eb-4041-a79f-241a9f85b35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.objects.instance [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f140de9-a7eb-4041-a79f-241a9f85b35b {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Successfully created port: f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:48:37 user nova-compute[73458]:   <uuid>9f140de9-a7eb-4041-a79f-241a9f85b35b</uuid>
Aug 27 00:48:37 user nova-compute[73458]:   <name>instance-00000002</name>
Aug 27 00:48:37 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:48:37 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:48:37 user nova-compute[73458]:   <metadata>
Aug 27 00:48:37 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:48:37 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:name>tempest-ServersNegativeTestJSON-server-1627516867</nova:name>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:48:37</nova:creationTime>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:48:37 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:48:37 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:owner>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:user uuid="24e9f78541bc45c48b4e0637f666e9cd">tempest-ServersNegativeTestJSON-2010218333-project-member</nova:user>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:project uuid="2d6f575c140547d2ae48ed7dea334375">tempest-ServersNegativeTestJSON-2010218333</nova:project>
Aug 27 00:48:37 user nova-compute[73458]:       </nova:owner>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:48:37 user nova-compute[73458]:       <nova:ports>
Aug 27 00:48:37 user nova-compute[73458]:         <nova:port uuid="6fef02f1-8592-4b68-ac49-03ee0e1f721e">
Aug 27 00:48:37 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:48:37 user nova-compute[73458]:         </nova:port>
Aug 27 00:48:37 user nova-compute[73458]:       </nova:ports>
Aug 27 00:48:37 user nova-compute[73458]:     </nova:instance>
Aug 27 00:48:37 user nova-compute[73458]:   </metadata>
Aug 27 00:48:37 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:48:37 user nova-compute[73458]:     <system>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="serial">9f140de9-a7eb-4041-a79f-241a9f85b35b</entry>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="uuid">9f140de9-a7eb-4041-a79f-241a9f85b35b</entry>
Aug 27 00:48:37 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:48:37 user nova-compute[73458]:     </system>
Aug 27 00:48:37 user nova-compute[73458]:   </sysinfo>
Aug 27 00:48:37 user nova-compute[73458]:   <os>
Aug 27 00:48:37 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:48:37 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:48:37 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:48:37 user nova-compute[73458]:   </os>
Aug 27 00:48:37 user nova-compute[73458]:   <features>
Aug 27 00:48:37 user nova-compute[73458]:     <acpi/>
Aug 27 00:48:37 user nova-compute[73458]:     <apic/>
Aug 27 00:48:37 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:48:37 user nova-compute[73458]:   </features>
Aug 27 00:48:37 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:48:37 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:48:37 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:48:37 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:48:37 user nova-compute[73458]:   </clock>
Aug 27 00:48:37 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:48:37 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:48:37 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:48:37 user nova-compute[73458]:   </cpu>
Aug 27 00:48:37 user nova-compute[73458]:   <devices>
Aug 27 00:48:37 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:48:37 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:48:37 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk"/>
Aug 27 00:48:37 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:48:37 user nova-compute[73458]:     </disk>
Aug 27 00:48:37 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:48:37 user nova-compute[73458]:       <mac address="fa:16:3e:61:98:3b"/>
Aug 27 00:48:37 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:37 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:48:37 user nova-compute[73458]:       <target dev="tap6fef02f1-85"/>
Aug 27 00:48:37 user nova-compute[73458]:     </interface>
Aug 27 00:48:37 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:48:37 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/console.log" append="off"/>
Aug 27 00:48:37 user nova-compute[73458]:     </serial>
Aug 27 00:48:37 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:48:37 user nova-compute[73458]:     <video>
Aug 27 00:48:37 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:37 user nova-compute[73458]:     </video>
Aug 27 00:48:37 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:48:37 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:48:37 user nova-compute[73458]:     </rng>
Aug 27 00:48:37 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:48:37 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:48:37 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:48:37 user nova-compute[73458]:     </memballoon>
Aug 27 00:48:37 user nova-compute[73458]:   </devices>
Aug 27 00:48:37 user nova-compute[73458]: </domain>
Aug 27 00:48:37 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1627516867',display_name='tempest-ServersNegativeTestJSON-server-1627516867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1627516867',id=2,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-1ts7k3dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:32Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=9f140de9-a7eb-4041-a79f-241a9f85b35b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG os_vif [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Created schema index Interface.name {{(pid=73458) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Created schema index Port.name {{(pid=73458) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Created schema index Bridge.name {{(pid=73458) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Successfully updated port: c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [POLLOUT] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquired lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:48:37 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7wuobljk/privsep.sock']
Aug 27 00:48:37 user sudo[82824]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7wuobljk/privsep.sock
Aug 27 00:48:37 user sudo[82824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 00:48:38 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:48:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-changed-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:48:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Refreshing instance network info cache due to event network-changed-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:48:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] Acquiring lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updated VIF entry in instance network info cache for port 6fef02f1-8592-4b68-ac49-03ee0e1f721e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-58abad61-2e01-4dda-b9cb-318d510b77d8 req-f08175aa-8dd1-441a-bea1-2a2260a62618 service nova] Releasing lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updating instance_info_cache with network_info: [{"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Releasing lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Instance network_info: |[{"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] Acquired lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Refreshing network info cache for port c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Start _get_guest_xml network_info=[{"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:48:39 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:39 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1941822667',display_name='tempest-DeleteServersTestJSON-server-1941822667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1941822667',id=1,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad18e0f41df146e382f6524daa86a75d',ramdisk_id='',reservation_id='r-2jqld5jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1353834451',owner_user_name='tempest-DeleteServersTestJSON-1353834451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:30Z,user_data=None,user_id='0df48c36952f4b4581209d4cde322dbe',uuid=2bb72ec0-49d0-492d-b004-c0af11aeed8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converting VIF {"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.objects.instance [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bb72ec0-49d0-492d-b004-c0af11aeed8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:48:39 user nova-compute[73458]:   <uuid>2bb72ec0-49d0-492d-b004-c0af11aeed8c</uuid>
Aug 27 00:48:39 user nova-compute[73458]:   <name>instance-00000001</name>
Aug 27 00:48:39 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:48:39 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:48:39 user nova-compute[73458]:   <metadata>
Aug 27 00:48:39 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:48:39 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:name>tempest-DeleteServersTestJSON-server-1941822667</nova:name>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:48:39</nova:creationTime>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:48:39 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:48:39 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:owner>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:user uuid="0df48c36952f4b4581209d4cde322dbe">tempest-DeleteServersTestJSON-1353834451-project-member</nova:user>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:project uuid="ad18e0f41df146e382f6524daa86a75d">tempest-DeleteServersTestJSON-1353834451</nova:project>
Aug 27 00:48:39 user nova-compute[73458]:       </nova:owner>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:48:39 user nova-compute[73458]:       <nova:ports>
Aug 27 00:48:39 user nova-compute[73458]:         <nova:port uuid="c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f">
Aug 27 00:48:39 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 00:48:39 user nova-compute[73458]:         </nova:port>
Aug 27 00:48:39 user nova-compute[73458]:       </nova:ports>
Aug 27 00:48:39 user nova-compute[73458]:     </nova:instance>
Aug 27 00:48:39 user nova-compute[73458]:   </metadata>
Aug 27 00:48:39 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:48:39 user nova-compute[73458]:     <system>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="serial">2bb72ec0-49d0-492d-b004-c0af11aeed8c</entry>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="uuid">2bb72ec0-49d0-492d-b004-c0af11aeed8c</entry>
Aug 27 00:48:39 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:48:39 user nova-compute[73458]:     </system>
Aug 27 00:48:39 user nova-compute[73458]:   </sysinfo>
Aug 27 00:48:39 user nova-compute[73458]:   <os>
Aug 27 00:48:39 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:48:39 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:48:39 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:48:39 user nova-compute[73458]:   </os>
Aug 27 00:48:39 user nova-compute[73458]:   <features>
Aug 27 00:48:39 user nova-compute[73458]:     <acpi/>
Aug 27 00:48:39 user nova-compute[73458]:     <apic/>
Aug 27 00:48:39 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:48:39 user nova-compute[73458]:   </features>
Aug 27 00:48:39 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:48:39 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:48:39 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:48:39 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:48:39 user nova-compute[73458]:   </clock>
Aug 27 00:48:39 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:48:39 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:48:39 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:48:39 user nova-compute[73458]:   </cpu>
Aug 27 00:48:39 user nova-compute[73458]:   <devices>
Aug 27 00:48:39 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:48:39 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:48:39 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk"/>
Aug 27 00:48:39 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:48:39 user nova-compute[73458]:     </disk>
Aug 27 00:48:39 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:48:39 user nova-compute[73458]:       <mac address="fa:16:3e:59:4e:15"/>
Aug 27 00:48:39 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:39 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:48:39 user nova-compute[73458]:       <target dev="tapc3f75f6c-f8"/>
Aug 27 00:48:39 user nova-compute[73458]:     </interface>
Aug 27 00:48:39 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:48:39 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/console.log" append="off"/>
Aug 27 00:48:39 user nova-compute[73458]:     </serial>
Aug 27 00:48:39 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:48:39 user nova-compute[73458]:     <video>
Aug 27 00:48:39 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:39 user nova-compute[73458]:     </video>
Aug 27 00:48:39 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:48:39 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:48:39 user nova-compute[73458]:     </rng>
Aug 27 00:48:39 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:48:39 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:48:39 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:48:39 user nova-compute[73458]:     </memballoon>
Aug 27 00:48:39 user nova-compute[73458]:   </devices>
Aug 27 00:48:39 user nova-compute[73458]: </domain>
Aug 27 00:48:39 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1941822667',display_name='tempest-DeleteServersTestJSON-server-1941822667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1941822667',id=1,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad18e0f41df146e382f6524daa86a75d',ramdisk_id='',reservation_id='r-2jqld5jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1353834451',owner_user_name='tempest-DeleteServersTestJSON-1353834451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:30Z,user_data=None,user_id='0df48c36952f4b4581209d4cde322dbe',uuid=2bb72ec0-49d0-492d-b004-c0af11aeed8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converting VIF {"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG os_vif [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:48:39 user sudo[82824]: pam_unix(sudo:session): session closed for user root
Aug 27 00:48:39 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Spawned new privsep daemon via rootwrap
Aug 27 00:48:39 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 00:48:39 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 00:48:39 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 27 00:48:39 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82832
Aug 27 00:48:39 user nova-compute[73458]: WARNING oslo_privsep.priv_context [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] privsep daemon already running
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fef02f1-85, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fef02f1-85, col_values=(('external_ids', {'iface-id': '6fef02f1-8592-4b68-ac49-03ee0e1f721e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:98:3b', 'vm-uuid': '9f140de9-a7eb-4041-a79f-241a9f85b35b'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: INFO os_vif [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85')
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f75f6c-f8, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3f75f6c-f8, col_values=(('external_ids', {'iface-id': 'c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:4e:15', 'vm-uuid': '2bb72ec0-49d0-492d-b004-c0af11aeed8c'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:40 user nova-compute[73458]: INFO os_vif [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8')
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Successfully updated port: f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] No VIF found with MAC fa:16:3e:61:98:3b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] No VIF found with MAC fa:16:3e:59:4e:15, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-changed-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Refreshing instance network info cache due to event network-changed-f4a1c5ef-9fa2-4b59-98a2-1b220f512442. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance network_info: |[{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Refreshing network info cache for port f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start _get_guest_xml network_info=[{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:48:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'pci_devices' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:48:41 user nova-compute[73458]:   <uuid>014595b9-5cb2-4a12-a96c-b57ee091c8ed</uuid>
Aug 27 00:48:41 user nova-compute[73458]:   <name>instance-00000003</name>
Aug 27 00:48:41 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:48:41 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:48:41 user nova-compute[73458]:   <metadata>
Aug 27 00:48:41 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:48:41 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherB-server-193534920</nova:name>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:48:41</nova:creationTime>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:48:41 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:48:41 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:owner>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:user uuid="01ccff6ef49a4362a6576ccf9cbbf552">tempest-ServerActionsTestOtherB-1527688410-project-member</nova:user>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:project uuid="580bff8187b74188bf3d77bb1413ba5d">tempest-ServerActionsTestOtherB-1527688410</nova:project>
Aug 27 00:48:41 user nova-compute[73458]:       </nova:owner>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:48:41 user nova-compute[73458]:       <nova:ports>
Aug 27 00:48:41 user nova-compute[73458]:         <nova:port uuid="f4a1c5ef-9fa2-4b59-98a2-1b220f512442">
Aug 27 00:48:41 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:48:41 user nova-compute[73458]:         </nova:port>
Aug 27 00:48:41 user nova-compute[73458]:       </nova:ports>
Aug 27 00:48:41 user nova-compute[73458]:     </nova:instance>
Aug 27 00:48:41 user nova-compute[73458]:   </metadata>
Aug 27 00:48:41 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:48:41 user nova-compute[73458]:     <system>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="serial">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="uuid">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:48:41 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:48:41 user nova-compute[73458]:     </system>
Aug 27 00:48:41 user nova-compute[73458]:   </sysinfo>
Aug 27 00:48:41 user nova-compute[73458]:   <os>
Aug 27 00:48:41 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:48:41 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:48:41 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:48:41 user nova-compute[73458]:   </os>
Aug 27 00:48:41 user nova-compute[73458]:   <features>
Aug 27 00:48:41 user nova-compute[73458]:     <acpi/>
Aug 27 00:48:41 user nova-compute[73458]:     <apic/>
Aug 27 00:48:41 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:48:41 user nova-compute[73458]:   </features>
Aug 27 00:48:41 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:48:41 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:48:41 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:48:41 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:48:41 user nova-compute[73458]:   </clock>
Aug 27 00:48:41 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:48:41 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:48:41 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:48:41 user nova-compute[73458]:   </cpu>
Aug 27 00:48:41 user nova-compute[73458]:   <devices>
Aug 27 00:48:41 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:48:41 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:48:41 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk"/>
Aug 27 00:48:41 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:48:41 user nova-compute[73458]:     </disk>
Aug 27 00:48:41 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:48:41 user nova-compute[73458]:       <mac address="fa:16:3e:e4:e1:1e"/>
Aug 27 00:48:41 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:41 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:48:41 user nova-compute[73458]:       <target dev="tapf4a1c5ef-9f"/>
Aug 27 00:48:41 user nova-compute[73458]:     </interface>
Aug 27 00:48:41 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:48:41 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/console.log" append="off"/>
Aug 27 00:48:41 user nova-compute[73458]:     </serial>
Aug 27 00:48:41 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:48:41 user nova-compute[73458]:     <video>
Aug 27 00:48:41 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:48:41 user nova-compute[73458]:     </video>
Aug 27 00:48:41 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:48:41 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:48:41 user nova-compute[73458]:     </rng>
Aug 27 00:48:41 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:48:41 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:48:41 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:48:41 user nova-compute[73458]:     </memballoon>
Aug 27 00:48:41 user nova-compute[73458]:   </devices>
Aug 27 00:48:41 user nova-compute[73458]: </domain>
Aug 27 00:48:41 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:48:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG os_vif [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a1c5ef-9f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4a1c5ef-9f, col_values=(('external_ids', {'iface-id': 'f4a1c5ef-9fa2-4b59-98a2-1b220f512442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:e1:1e', 'vm-uuid': '014595b9-5cb2-4a12-a96c-b57ee091c8ed'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:41 user nova-compute[73458]: INFO os_vif [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No VIF found with MAC fa:16:3e:e4:e1:1e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updated VIF entry in instance network info cache for port c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updating instance_info_cache with network_info: [{"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f958227-f97a-4321-a090-21ecc0678238 req-258d29a6-a0bc-47b0-9f25-436c132b466b service nova] Releasing lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updated VIF entry in instance network info cache for port f4a1c5ef-9fa2-4b59-98a2-1b220f512442. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:48:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:48:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3c658d7-21ef-4292-9c85-624abadfd1bb req-a6f14eca-10e6-454e-b106-f60fa16543a4 service nova] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:48:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.5715168, 9f140de9-a7eb-4041-a79f-241a9f85b35b => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] VM Resumed (Lifecycle Event)
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Instance spawned successfully.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Instance spawned successfully.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.5797145, 9f140de9-a7eb-4041-a79f-241a9f85b35b => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] VM Started (Lifecycle Event)
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance spawned successfully.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Took 17.04 seconds to spawn the instance on the hypervisor.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:48:46 user nova-compute[73458]: INFO nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Took 15.04 seconds to spawn the instance on the hypervisor.
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.5857966, 2bb72ec0-49d0-492d-b004-c0af11aeed8c => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] VM Resumed (Lifecycle Event)
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Took 11.53 seconds to spawn the instance on the hypervisor.
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Took 18.09 seconds to build instance.
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.5871856, 2bb72ec0-49d0-492d-b004-c0af11aeed8c => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] VM Started (Lifecycle Event)
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-40c15366-99e1-47e9-ae7b-515a68ee1c1f tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.384s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Took 16.15 seconds to build instance.
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Took 12.45 seconds to build instance.
Aug 27 00:48:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-528f7868-1da3-4cbd-b5b1-f19773d81fc6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.326s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.8317666, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Resumed (Lifecycle Event)
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9e11b15-d2a2-4593-9d37-8ba474f85ad9 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.762s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097326.8339858, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:48:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Started (Lifecycle Event)
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:48:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:48:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:00 user nova-compute[73458]: INFO nova.compute.claims [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Claim successful on node user
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG nova.policy [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cd86ab850fa4504992ce17b059c6913', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c0009acfe4ab6868908ca1d05c978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:49:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Creating image(s)
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.part --force-share --output=json" returned: 0 in 0.343s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.virt.images [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] 43a81ed6-1b9d-4b52-a36e-72e421b38442 was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.part /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Successfully created port: 3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:02 user nova-compute[73458]: INFO nova.compute.claims [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Claim successful on node user
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.part /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.converted" returned: 0 in 0.255s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.390s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c,backing_fmt=raw /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c,backing_fmt=raw /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk 1073741824" returned: 0 in 0.077s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "85524c5bc6f8d5890bcb983e1ad6766ea1173b7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.policy [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a77564556f9e41ff9bbe4e77d9c08c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f191e470513741d7b951be664ca14122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c --force-share --output=json" returned: 0 in 0.264s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Successfully updated port: 3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquired lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-changed-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Refreshing instance network info cache due to event network-changed-3685bf83-03cd-4f89-bffc-e6c1f74dde2f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] Acquiring lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:49:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Creating image(s)
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Cannot resize image /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Ensure instance console log exists: /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.263s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updating instance_info_cache with network_info: [{"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Releasing lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Instance network_info: |[{"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] Acquired lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Refreshing network info cache for port 3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Start _get_guest_xml network_info=[{"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:48:50Z,direct_url=<?>,disk_format='qcow2',id=43a81ed6-1b9d-4b52-a36e-72e421b38442,min_disk=0,min_ram=0,name='',owner='e2cde5a881584f01962f9ef850b0d12f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:48:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'guest_format': None, 'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '43a81ed6-1b9d-4b52-a36e-72e421b38442'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.350s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk 1073741824" returned: 0 in 0.116s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.473s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:48:50Z,direct_url=<?>,disk_format='qcow2',id=43a81ed6-1b9d-4b52-a36e-72e421b38442,min_disk=0,min_ram=0,name='',owner='e2cde5a881584f01962f9ef850b0d12f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:48:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-83362416',display_name='tempest-AttachSCSIVolumeTestJSON-server-83362416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-83362416',id=4,image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+AgaLFIOBs6w3umYI3lAeQTid3QVJxuE6sYzik67uGdEOnIdKed6rUWH/hIZxOBPwlRxJVt1dH9hdw5ceq/4xoVBagce0E2F9/u8gKXXypj8h5n3jjkOWGoqyMXr26HA==',key_name='tempest-keypair-1324839820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c0009acfe4ab6868908ca1d05c978',ramdisk_id='',reservation_id='r-eg12f1f1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1958255642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1958255642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cd86ab850fa4504992ce17b059c6913',uuid=9613067b-3440-4584-a2a2-38535e913dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converting VIF {"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lazy-loading 'pci_devices' on Instance uuid 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:49:04 user nova-compute[73458]:   <uuid>9613067b-3440-4584-a2a2-38535e913dce</uuid>
Aug 27 00:49:04 user nova-compute[73458]:   <name>instance-00000004</name>
Aug 27 00:49:04 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:49:04 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:49:04 user nova-compute[73458]:   <metadata>
Aug 27 00:49:04 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:49:04 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-83362416</nova:name>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:49:04</nova:creationTime>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:49:04 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:49:04 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:owner>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:user uuid="1cd86ab850fa4504992ce17b059c6913">tempest-AttachSCSIVolumeTestJSON-1958255642-project-member</nova:user>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:project uuid="4f6c0009acfe4ab6868908ca1d05c978">tempest-AttachSCSIVolumeTestJSON-1958255642</nova:project>
Aug 27 00:49:04 user nova-compute[73458]:       </nova:owner>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:root type="image" uuid="43a81ed6-1b9d-4b52-a36e-72e421b38442"/>
Aug 27 00:49:04 user nova-compute[73458]:       <nova:ports>
Aug 27 00:49:04 user nova-compute[73458]:         <nova:port uuid="3685bf83-03cd-4f89-bffc-e6c1f74dde2f">
Aug 27 00:49:04 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 00:49:04 user nova-compute[73458]:         </nova:port>
Aug 27 00:49:04 user nova-compute[73458]:       </nova:ports>
Aug 27 00:49:04 user nova-compute[73458]:     </nova:instance>
Aug 27 00:49:04 user nova-compute[73458]:   </metadata>
Aug 27 00:49:04 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:49:04 user nova-compute[73458]:     <system>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="serial">9613067b-3440-4584-a2a2-38535e913dce</entry>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="uuid">9613067b-3440-4584-a2a2-38535e913dce</entry>
Aug 27 00:49:04 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:49:04 user nova-compute[73458]:     </system>
Aug 27 00:49:04 user nova-compute[73458]:   </sysinfo>
Aug 27 00:49:04 user nova-compute[73458]:   <os>
Aug 27 00:49:04 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:49:04 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:49:04 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:49:04 user nova-compute[73458]:   </os>
Aug 27 00:49:04 user nova-compute[73458]:   <features>
Aug 27 00:49:04 user nova-compute[73458]:     <acpi/>
Aug 27 00:49:04 user nova-compute[73458]:     <apic/>
Aug 27 00:49:04 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:49:04 user nova-compute[73458]:   </features>
Aug 27 00:49:04 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:49:04 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:49:04 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:49:04 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:49:04 user nova-compute[73458]:   </clock>
Aug 27 00:49:04 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:49:04 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:49:04 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:49:04 user nova-compute[73458]:   </cpu>
Aug 27 00:49:04 user nova-compute[73458]:   <devices>
Aug 27 00:49:04 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:49:04 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:49:04 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk"/>
Aug 27 00:49:04 user nova-compute[73458]:       <target dev="sda" bus="scsi"/>
Aug 27 00:49:04 user nova-compute[73458]:       <address type="drive" controller="0" unit="0"/>
Aug 27 00:49:04 user nova-compute[73458]:     </disk>
Aug 27 00:49:04 user nova-compute[73458]:     <disk type="file" device="cdrom">
Aug 27 00:49:04 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 00:49:04 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.config"/>
Aug 27 00:49:04 user nova-compute[73458]:       <target dev="sdb" bus="scsi"/>
Aug 27 00:49:04 user nova-compute[73458]:       <address type="drive" controller="0" unit="1"/>
Aug 27 00:49:04 user nova-compute[73458]:     </disk>
Aug 27 00:49:04 user nova-compute[73458]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 27 00:49:04 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:49:04 user nova-compute[73458]:       <mac address="fa:16:3e:3c:80:d2"/>
Aug 27 00:49:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:04 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:49:04 user nova-compute[73458]:       <target dev="tap3685bf83-03"/>
Aug 27 00:49:04 user nova-compute[73458]:     </interface>
Aug 27 00:49:04 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:49:04 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/console.log" append="off"/>
Aug 27 00:49:04 user nova-compute[73458]:     </serial>
Aug 27 00:49:04 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:49:04 user nova-compute[73458]:     <video>
Aug 27 00:49:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:04 user nova-compute[73458]:     </video>
Aug 27 00:49:04 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:49:04 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:49:04 user nova-compute[73458]:     </rng>
Aug 27 00:49:04 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:49:04 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:49:04 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:49:04 user nova-compute[73458]:     </memballoon>
Aug 27 00:49:04 user nova-compute[73458]:   </devices>
Aug 27 00:49:04 user nova-compute[73458]: </domain>
Aug 27 00:49:04 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-83362416',display_name='tempest-AttachSCSIVolumeTestJSON-server-83362416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-83362416',id=4,image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+AgaLFIOBs6w3umYI3lAeQTid3QVJxuE6sYzik67uGdEOnIdKed6rUWH/hIZxOBPwlRxJVt1dH9hdw5ceq/4xoVBagce0E2F9/u8gKXXypj8h5n3jjkOWGoqyMXr26HA==',key_name='tempest-keypair-1324839820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f6c0009acfe4ab6868908ca1d05c978',ramdisk_id='',reservation_id='r-eg12f1f1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1958255642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1958255642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cd86ab850fa4504992ce17b059c6913',uuid=9613067b-3440-4584-a2a2-38535e913dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converting VIF {"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG os_vif [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.333s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Successfully created port: 0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3685bf83-03, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3685bf83-03, col_values=(('external_ids', {'iface-id': '3685bf83-03cd-4f89-bffc-e6c1f74dde2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:80:d2', 'vm-uuid': '9613067b-3440-4584-a2a2-38535e913dce'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:04 user nova-compute[73458]: INFO os_vif [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03')
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No BDM found with device name sda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No VIF found with MAC fa:16:3e:3c:80:d2, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:49:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Using config drive
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.427s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Cannot resize image /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Ensure instance console log exists: /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updated VIF entry in instance network info cache for port 3685bf83-03cd-4f89-bffc-e6c1f74dde2f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updating instance_info_cache with network_info: [{"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb574fb9-d645-4fba-943c-cddff27eacd8 req-b9061a39-0d48-4d10-b0b4-a0a36dd0ab62 service nova] Releasing lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Creating config drive at /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.config
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7vvrtwo0 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7vvrtwo0" returned: 0 in 0.092s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Successfully updated port: 0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-changed-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing instance network info cache due to event network-changed-0c2bca75-976d-49fe-a789-30aacb954db8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Instance network_info: |[{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing network info cache for port 0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Start _get_guest_xml network_info=[{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:49:07 user nova-compute[73458]:   <uuid>2f2d4e39-0c45-448e-add7-f053858edd8c</uuid>
Aug 27 00:49:07 user nova-compute[73458]:   <name>instance-00000005</name>
Aug 27 00:49:07 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:49:07 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:49:07 user nova-compute[73458]:   <metadata>
Aug 27 00:49:07 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:49:07 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:49:07</nova:creationTime>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:49:07 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:49:07 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:owner>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:49:07 user nova-compute[73458]:       </nova:owner>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:49:07 user nova-compute[73458]:       <nova:ports>
Aug 27 00:49:07 user nova-compute[73458]:         <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:49:07 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:49:07 user nova-compute[73458]:         </nova:port>
Aug 27 00:49:07 user nova-compute[73458]:       </nova:ports>
Aug 27 00:49:07 user nova-compute[73458]:     </nova:instance>
Aug 27 00:49:07 user nova-compute[73458]:   </metadata>
Aug 27 00:49:07 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:49:07 user nova-compute[73458]:     <system>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="serial">2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="uuid">2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:49:07 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:49:07 user nova-compute[73458]:     </system>
Aug 27 00:49:07 user nova-compute[73458]:   </sysinfo>
Aug 27 00:49:07 user nova-compute[73458]:   <os>
Aug 27 00:49:07 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:49:07 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:49:07 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:49:07 user nova-compute[73458]:   </os>
Aug 27 00:49:07 user nova-compute[73458]:   <features>
Aug 27 00:49:07 user nova-compute[73458]:     <acpi/>
Aug 27 00:49:07 user nova-compute[73458]:     <apic/>
Aug 27 00:49:07 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:49:07 user nova-compute[73458]:   </features>
Aug 27 00:49:07 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:49:07 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:49:07 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:49:07 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:49:07 user nova-compute[73458]:   </clock>
Aug 27 00:49:07 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:49:07 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:49:07 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:49:07 user nova-compute[73458]:   </cpu>
Aug 27 00:49:07 user nova-compute[73458]:   <devices>
Aug 27 00:49:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:49:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:49:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk"/>
Aug 27 00:49:07 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:49:07 user nova-compute[73458]:     </disk>
Aug 27 00:49:07 user nova-compute[73458]:     <disk type="file" device="cdrom">
Aug 27 00:49:07 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 00:49:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config"/>
Aug 27 00:49:07 user nova-compute[73458]:       <target dev="hda" bus="ide"/>
Aug 27 00:49:07 user nova-compute[73458]:     </disk>
Aug 27 00:49:07 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:49:07 user nova-compute[73458]:       <mac address="fa:16:3e:4b:0e:c3"/>
Aug 27 00:49:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:07 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:49:07 user nova-compute[73458]:       <target dev="tap0c2bca75-97"/>
Aug 27 00:49:07 user nova-compute[73458]:     </interface>
Aug 27 00:49:07 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:49:07 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log" append="off"/>
Aug 27 00:49:07 user nova-compute[73458]:     </serial>
Aug 27 00:49:07 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:49:07 user nova-compute[73458]:     <video>
Aug 27 00:49:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:07 user nova-compute[73458]:     </video>
Aug 27 00:49:07 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:49:07 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:49:07 user nova-compute[73458]:     </rng>
Aug 27 00:49:07 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:49:07 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:49:07 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:49:07 user nova-compute[73458]:     </memballoon>
Aug 27 00:49:07 user nova-compute[73458]:   </devices>
Aug 27 00:49:07 user nova-compute[73458]: </domain>
Aug 27 00:49:07 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG os_vif [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c2bca75-97, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c2bca75-97, col_values=(('external_ids', {'iface-id': '0c2bca75-976d-49fe-a789-30aacb954db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0e:c3', 'vm-uuid': '2f2d4e39-0c45-448e-add7-f053858edd8c'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:07 user nova-compute[73458]: INFO os_vif [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97')
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name hda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No VIF found with MAC fa:16:3e:4b:0e:c3, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:49:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Using config drive
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] No waiting events found dispatching network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:07 user nova-compute[73458]: WARNING nova.compute.manager [req-3dc65164-b18e-4982-97e9-9e51716be3bf req-8a13ca85-bc79-4c5c-b190-89d826548850 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received unexpected event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f for instance with vm_state building and task_state spawning.
Aug 27 00:49:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Creating config drive at /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config
Aug 27 00:49:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb7zykhez {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpb7zykhez" returned: 0 in 0.095s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updated VIF entry in instance network info cache for port 0c2bca75-976d-49fe-a789-30aacb954db8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee89ecbd-164f-4914-b682-1a857b31468b req-4377926f-a30e-426d-be3e-3d537a96ccd3 service nova] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:09 user nova-compute[73458]: INFO nova.compute.claims [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Claim successful on node user
Aug 27 00:49:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] No waiting events found dispatching network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:09 user nova-compute[73458]: WARNING nova.compute.manager [req-67aed327-0d1f-44ee-8b33-afc7d969f1ec req-c59bd471-f11c-4d85-b020-f550b1d91ebc service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received unexpected event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f for instance with vm_state building and task_state spawning.
Aug 27 00:49:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097350.7363937, 9613067b-3440-4584-a2a2-38535e913dce => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] VM Resumed (Lifecycle Event)
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Instance spawned successfully.
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.policy [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bafa02029a1147549da86df0613c9c36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36f8db7ce1e447fa34b1f73c271ea0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097350.7366204, 9613067b-3440-4584-a2a2-38535e913dce => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] VM Started (Lifecycle Event)
Aug 27 00:49:10 user nova-compute[73458]: INFO nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Took 9.75 seconds to spawn the instance on the hypervisor.
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:49:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Creating image(s)
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "/opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "/opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.174s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:11 user nova-compute[73458]: INFO nova.compute.manager [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Took 11.17 seconds to build instance.
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac5913b-0760-49c3-89df-b577076bc3db tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.324s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.257s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.230s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk 1073741824" returned: 0 in 0.063s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:11 user nova-compute[73458]: WARNING nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 for instance with vm_state building and task_state spawning.
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:11 user nova-compute[73458]: WARNING nova.compute.manager [req-30102c33-46a8-43a5-ac62-ffeb524c0bcf req-7e88bb4a-6023-49b6-a386-68ce034c25d7 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 for instance with vm_state building and task_state spawning.
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Cannot resize image /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Ensure instance console log exists: /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Successfully created port: 7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097353.2829347, 2f2d4e39-0c45-448e-add7-f053858edd8c => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] VM Resumed (Lifecycle Event)
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Instance spawned successfully.
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.claims [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Claim successful on node user
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097353.2837765, 2f2d4e39-0c45-448e-add7-f053858edd8c => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] VM Started (Lifecycle Event)
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Took 9.97 seconds to spawn the instance on the hypervisor.
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:13 user nova-compute[73458]: INFO nova.compute.manager [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Took 11.51 seconds to build instance.
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1de7deb-dcd4-44e3-a86a-b1389ada5636 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.906s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Successfully updated port: 7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquired lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-changed-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Refreshing instance network info cache due to event network-changed-7e8414ef-1dbd-4753-bb49-b5291bb84ad8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] Acquiring lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:13 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.policy [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9ec112c9cf94ecea071b1db01a3d811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac76c536b5304a01a3b3af02127b20b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:49:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Creating image(s)
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "/opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "/opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "/opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.330s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.303s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating instance_info_cache with network_info: [{"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk 1073741824" returned: 0 in 0.058s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Releasing lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Instance network_info: |[{"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] Acquired lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Refreshing network info cache for port 7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Start _get_guest_xml network_info=[{"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:49:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1427813982',display_name='tempest-VolumesAssistedSnapshotsTest-server-1427813982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1427813982',id=6,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEKdJTs5hhChu9U3Yfp1lH3/pjxHWf4ap4NRvA5/UGQY9z/BwSnhBuRmjElbeetRUFPUmKhZPqPVco2edlhUAdCEjHxw/BhsrMBuqCz1apFycwIEaCcno6CJJmzECm/9Q==',key_name='tempest-keypair-662515319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e36f8db7ce1e447fa34b1f73c271ea0a',ramdisk_id='',reservation_id='r-1zx3175t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-714309587',owner_user_name='tempest-VolumesAssistedSnapshotsTest-714309587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa02029a1147549da86df0613c9c36',uuid=b7b683b7-a32c-42ee-9ee0-10bb03611810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converting VIF {"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lazy-loading 'pci_devices' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.250s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:49:15 user nova-compute[73458]:   <uuid>b7b683b7-a32c-42ee-9ee0-10bb03611810</uuid>
Aug 27 00:49:15 user nova-compute[73458]:   <name>instance-00000006</name>
Aug 27 00:49:15 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:49:15 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:49:15 user nova-compute[73458]:   <metadata>
Aug 27 00:49:15 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:49:15 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1427813982</nova:name>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:49:15</nova:creationTime>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:49:15 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:49:15 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:owner>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:user uuid="bafa02029a1147549da86df0613c9c36">tempest-VolumesAssistedSnapshotsTest-714309587-project-member</nova:user>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:project uuid="e36f8db7ce1e447fa34b1f73c271ea0a">tempest-VolumesAssistedSnapshotsTest-714309587</nova:project>
Aug 27 00:49:15 user nova-compute[73458]:       </nova:owner>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:49:15 user nova-compute[73458]:       <nova:ports>
Aug 27 00:49:15 user nova-compute[73458]:         <nova:port uuid="7e8414ef-1dbd-4753-bb49-b5291bb84ad8">
Aug 27 00:49:15 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 00:49:15 user nova-compute[73458]:         </nova:port>
Aug 27 00:49:15 user nova-compute[73458]:       </nova:ports>
Aug 27 00:49:15 user nova-compute[73458]:     </nova:instance>
Aug 27 00:49:15 user nova-compute[73458]:   </metadata>
Aug 27 00:49:15 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:49:15 user nova-compute[73458]:     <system>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="serial">b7b683b7-a32c-42ee-9ee0-10bb03611810</entry>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="uuid">b7b683b7-a32c-42ee-9ee0-10bb03611810</entry>
Aug 27 00:49:15 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:49:15 user nova-compute[73458]:     </system>
Aug 27 00:49:15 user nova-compute[73458]:   </sysinfo>
Aug 27 00:49:15 user nova-compute[73458]:   <os>
Aug 27 00:49:15 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:49:15 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:49:15 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:49:15 user nova-compute[73458]:   </os>
Aug 27 00:49:15 user nova-compute[73458]:   <features>
Aug 27 00:49:15 user nova-compute[73458]:     <acpi/>
Aug 27 00:49:15 user nova-compute[73458]:     <apic/>
Aug 27 00:49:15 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:49:15 user nova-compute[73458]:   </features>
Aug 27 00:49:15 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:49:15 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:49:15 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:49:15 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:49:15 user nova-compute[73458]:   </clock>
Aug 27 00:49:15 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:49:15 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:49:15 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:49:15 user nova-compute[73458]:   </cpu>
Aug 27 00:49:15 user nova-compute[73458]:   <devices>
Aug 27 00:49:15 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:49:15 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:49:15 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk"/>
Aug 27 00:49:15 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:49:15 user nova-compute[73458]:     </disk>
Aug 27 00:49:15 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:49:15 user nova-compute[73458]:       <mac address="fa:16:3e:56:17:5b"/>
Aug 27 00:49:15 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:15 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:49:15 user nova-compute[73458]:       <target dev="tap7e8414ef-1d"/>
Aug 27 00:49:15 user nova-compute[73458]:     </interface>
Aug 27 00:49:15 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:49:15 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/console.log" append="off"/>
Aug 27 00:49:15 user nova-compute[73458]:     </serial>
Aug 27 00:49:15 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:49:15 user nova-compute[73458]:     <video>
Aug 27 00:49:15 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:15 user nova-compute[73458]:     </video>
Aug 27 00:49:15 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:49:15 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:49:15 user nova-compute[73458]:     </rng>
Aug 27 00:49:15 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:49:15 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:49:15 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:49:15 user nova-compute[73458]:     </memballoon>
Aug 27 00:49:15 user nova-compute[73458]:   </devices>
Aug 27 00:49:15 user nova-compute[73458]: </domain>
Aug 27 00:49:15 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1427813982',display_name='tempest-VolumesAssistedSnapshotsTest-server-1427813982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1427813982',id=6,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEKdJTs5hhChu9U3Yfp1lH3/pjxHWf4ap4NRvA5/UGQY9z/BwSnhBuRmjElbeetRUFPUmKhZPqPVco2edlhUAdCEjHxw/BhsrMBuqCz1apFycwIEaCcno6CJJmzECm/9Q==',key_name='tempest-keypair-662515319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e36f8db7ce1e447fa34b1f73c271ea0a',ramdisk_id='',reservation_id='r-1zx3175t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-714309587',owner_user_name='tempest-VolumesAssistedSnapshotsTest-714309587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa02029a1147549da86df0613c9c36',uuid=b7b683b7-a32c-42ee-9ee0-10bb03611810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converting VIF {"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG os_vif [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8414ef-1d, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8414ef-1d, col_values=(('external_ids', {'iface-id': '7e8414ef-1dbd-4753-bb49-b5291bb84ad8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:17:5b', 'vm-uuid': 'b7b683b7-a32c-42ee-9ee0-10bb03611810'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:15 user nova-compute[73458]: INFO os_vif [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d')
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Successfully created port: 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Cannot resize image /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Ensure instance console log exists: /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] No VIF found with MAC fa:16:3e:56:17:5b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updated VIF entry in instance network info cache for port 7e8414ef-1dbd-4753-bb49-b5291bb84ad8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating instance_info_cache with network_info: [{"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b811d2c9-caa7-4338-adcf-fc5dd0f6ba9f req-842ac009-901e-4ad9-bacf-1e74952de333 service nova] Releasing lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Successfully updated port: 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquired lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-changed-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Refreshing instance network info cache due to event network-changed-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] Acquiring lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updating instance_info_cache with network_info: [{"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Releasing lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Instance network_info: |[{"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] Acquired lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Refreshing network info cache for port 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Start _get_guest_xml network_info=[{"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1522433354',display_name='tempest-TestVolumeSwap-server-1522433354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1522433354',id=7,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIPocWd43So4hjJPMiXLu4YYtO2Ufi601pq64gMQUkpzwCcxAosTIvTdo3Wd7LoYdrish/M0FNp8b3tmdS6f+yNOqICDGhOh4eXxnyKy4Zw0dmCj791nuMXH9rMlpUfVw==',key_name='tempest-keypair-1888365244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac76c536b5304a01a3b3af02127b20b1',ramdisk_id='',reservation_id='r-7nz82do2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-724115542',owner_user_name='tempest-TestVolumeSwap-724115542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9ec112c9cf94ecea071b1db01a3d811',uuid=c709b541-1fa2-406e-9210-fbfd4ac870ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converting VIF {"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lazy-loading 'pci_devices' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:49:17 user nova-compute[73458]:   <uuid>c709b541-1fa2-406e-9210-fbfd4ac870ac</uuid>
Aug 27 00:49:17 user nova-compute[73458]:   <name>instance-00000007</name>
Aug 27 00:49:17 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:49:17 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:49:17 user nova-compute[73458]:   <metadata>
Aug 27 00:49:17 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:49:17 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:name>tempest-TestVolumeSwap-server-1522433354</nova:name>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:49:17</nova:creationTime>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:49:17 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:49:17 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:owner>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:user uuid="c9ec112c9cf94ecea071b1db01a3d811">tempest-TestVolumeSwap-724115542-project-member</nova:user>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:project uuid="ac76c536b5304a01a3b3af02127b20b1">tempest-TestVolumeSwap-724115542</nova:project>
Aug 27 00:49:17 user nova-compute[73458]:       </nova:owner>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:49:17 user nova-compute[73458]:       <nova:ports>
Aug 27 00:49:17 user nova-compute[73458]:         <nova:port uuid="2076d0b7-1bdf-4797-8f8e-da4ab2c9a653">
Aug 27 00:49:17 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 00:49:17 user nova-compute[73458]:         </nova:port>
Aug 27 00:49:17 user nova-compute[73458]:       </nova:ports>
Aug 27 00:49:17 user nova-compute[73458]:     </nova:instance>
Aug 27 00:49:17 user nova-compute[73458]:   </metadata>
Aug 27 00:49:17 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:49:17 user nova-compute[73458]:     <system>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="serial">c709b541-1fa2-406e-9210-fbfd4ac870ac</entry>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="uuid">c709b541-1fa2-406e-9210-fbfd4ac870ac</entry>
Aug 27 00:49:17 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:49:17 user nova-compute[73458]:     </system>
Aug 27 00:49:17 user nova-compute[73458]:   </sysinfo>
Aug 27 00:49:17 user nova-compute[73458]:   <os>
Aug 27 00:49:17 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:49:17 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:49:17 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:49:17 user nova-compute[73458]:   </os>
Aug 27 00:49:17 user nova-compute[73458]:   <features>
Aug 27 00:49:17 user nova-compute[73458]:     <acpi/>
Aug 27 00:49:17 user nova-compute[73458]:     <apic/>
Aug 27 00:49:17 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:49:17 user nova-compute[73458]:   </features>
Aug 27 00:49:17 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:49:17 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:49:17 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:49:17 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:49:17 user nova-compute[73458]:   </clock>
Aug 27 00:49:17 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:49:17 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:49:17 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:49:17 user nova-compute[73458]:   </cpu>
Aug 27 00:49:17 user nova-compute[73458]:   <devices>
Aug 27 00:49:17 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:49:17 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:49:17 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk"/>
Aug 27 00:49:17 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:49:17 user nova-compute[73458]:     </disk>
Aug 27 00:49:17 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:49:17 user nova-compute[73458]:       <mac address="fa:16:3e:79:9d:83"/>
Aug 27 00:49:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:17 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:49:17 user nova-compute[73458]:       <target dev="tap2076d0b7-1b"/>
Aug 27 00:49:17 user nova-compute[73458]:     </interface>
Aug 27 00:49:17 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:49:17 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/console.log" append="off"/>
Aug 27 00:49:17 user nova-compute[73458]:     </serial>
Aug 27 00:49:17 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:49:17 user nova-compute[73458]:     <video>
Aug 27 00:49:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:17 user nova-compute[73458]:     </video>
Aug 27 00:49:17 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:49:17 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:49:17 user nova-compute[73458]:     </rng>
Aug 27 00:49:17 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:49:17 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:49:17 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:49:17 user nova-compute[73458]:     </memballoon>
Aug 27 00:49:17 user nova-compute[73458]:   </devices>
Aug 27 00:49:17 user nova-compute[73458]: </domain>
Aug 27 00:49:17 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1522433354',display_name='tempest-TestVolumeSwap-server-1522433354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1522433354',id=7,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIPocWd43So4hjJPMiXLu4YYtO2Ufi601pq64gMQUkpzwCcxAosTIvTdo3Wd7LoYdrish/M0FNp8b3tmdS6f+yNOqICDGhOh4eXxnyKy4Zw0dmCj791nuMXH9rMlpUfVw==',key_name='tempest-keypair-1888365244',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac76c536b5304a01a3b3af02127b20b1',ramdisk_id='',reservation_id='r-7nz82do2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-724115542',owner_user_name='tempest-TestVolumeSwap-724115542-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9ec112c9cf94ecea071b1db01a3d811',uuid=c709b541-1fa2-406e-9210-fbfd4ac870ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converting VIF {"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG os_vif [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2076d0b7-1b, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2076d0b7-1b, col_values=(('external_ids', {'iface-id': '2076d0b7-1bdf-4797-8f8e-da4ab2c9a653', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:9d:83', 'vm-uuid': 'c709b541-1fa2-406e-9210-fbfd4ac870ac'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: INFO os_vif [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b')
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] No VIF found with MAC fa:16:3e:79:9d:83, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updated VIF entry in instance network info cache for port 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updating instance_info_cache with network_info: [{"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cc027e19-3988-4966-b652-11962eb15a59 req-14839be3-7281-41ab-a97d-6decee740b21 service nova] Releasing lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 2bb72ec0-49d0-492d-b004-c0af11aeed8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] No waiting events found dispatching network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:18 user nova-compute[73458]: WARNING nova.compute.manager [req-44a99069-24a0-469c-8bf1-0f455b7615d9 req-99ade7e1-8d94-42ce-89dc-9047ee9eaf7f service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received unexpected event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 for instance with vm_state building and task_state spawning.
Aug 27 00:49:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updating instance_info_cache with network_info: [{"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-2bb72ec0-49d0-492d-b004-c0af11aeed8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] No waiting events found dispatching network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:20 user nova-compute[73458]: WARNING nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received unexpected event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 for instance with vm_state building and task_state spawning.
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] No waiting events found dispatching network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:20 user nova-compute[73458]: WARNING nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received unexpected event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 for instance with vm_state building and task_state spawning.
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] No waiting events found dispatching network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:20 user nova-compute[73458]: WARNING nova.compute.manager [req-d9057135-7cc7-4aeb-bdc3-94bfd0ce13fc req-7656d0aa-15b6-46f3-8da6-63ef37717276 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received unexpected event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 for instance with vm_state building and task_state spawning.
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] No waiting events found dispatching network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:21 user nova-compute[73458]: WARNING nova.compute.manager [req-aa336054-2608-4ae1-9faf-fe6b633bbe7d req-c000cd5b-3752-4b72-b752-f8f9bc3c08af service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received unexpected event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f for instance with vm_state active and task_state None.
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097361.8655844, b7b683b7-a32c-42ee-9ee0-10bb03611810 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] VM Resumed (Lifecycle Event)
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:49:21 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Instance spawned successfully.
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097361.866293, b7b683b7-a32c-42ee-9ee0-10bb03611810 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] VM Started (Lifecycle Event)
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Took 11.17 seconds to spawn the instance on the hypervisor.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Took 12.67 seconds to build instance.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6ec66e6f-db6e-46bf-a6e9-17c87939caf8 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.830s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097362.6002197, c709b541-1fa2-406e-9210-fbfd4ac870ac => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] VM Resumed (Lifecycle Event)
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Instance spawned successfully.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097362.6134262, c709b541-1fa2-406e-9210-fbfd4ac870ac => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] VM Started (Lifecycle Event)
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:22 user nova-compute[73458]: INFO nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 27 00:49:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:23 user nova-compute[73458]: INFO nova.compute.manager [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Took 9.69 seconds to build instance.
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af696c93-ba5e-48d4-b360-0f665591342f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.880s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] No waiting events found dispatching network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:23 user nova-compute[73458]: WARNING nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received unexpected event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f for instance with vm_state active and task_state None.
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] No waiting events found dispatching network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:23 user nova-compute[73458]: WARNING nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received unexpected event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e for instance with vm_state active and task_state None.
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] No waiting events found dispatching network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:23 user nova-compute[73458]: WARNING nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received unexpected event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e for instance with vm_state active and task_state None.
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:23 user nova-compute[73458]: WARNING nova.compute.manager [req-0f8c8058-3220-4f37-bc8f-2c5f77d4cc1b req-bd39612c-708e-4bbb-9bab-5a5c66491d17 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state None.
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7996MB free_disk=25.908641815185547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2bb72ec0-49d0-492d-b004-c0af11aeed8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9613067b-3440-4584-a2a2-38535e913dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2f2d4e39-0c45-448e-add7-f053858edd8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b7b683b7-a32c-42ee-9ee0-10bb03611810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c709b541-1fa2-406e-9210-fbfd4ac870ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:25 user nova-compute[73458]: WARNING nova.compute.manager [req-d2d45dc6-4bcd-4f4a-8129-4cefbda94605 req-ce174d87-e8dc-4f99-b7d0-8e628a8bf459 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state None.
Aug 27 00:49:26 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.390s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:49:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:49:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:28 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:28 user nova-compute[73458]: INFO nova.compute.claims [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Claim successful on node user
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:29 user nova-compute[73458]: DEBUG nova.policy [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad6b59eaab96447e885ff14e644aaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af9bf87985e40759127eaa701c05d67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:29 user nova-compute[73458]: INFO nova.virt.block_device [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Booting with volume b153e901-0356-4a3b-964f-3f17ee111a82 at /dev/vda
Aug 27 00:49:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:30 user nova-compute[73458]: DEBUG os_brick.utils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:49:30 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpeqy5hndw/privsep.sock']
Aug 27 00:49:30 user sudo[84124]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpeqy5hndw/privsep.sock
Aug 27 00:49:30 user sudo[84124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 00:49:30 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Successfully created port: d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Successfully updated port: d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquired lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-changed-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Refreshing instance network info cache due to event network-changed-d38e00a5-6077-4aa3-bfea-7897c6fa733a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] Acquiring lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:32 user sudo[84124]: pam_unix(sudo:session): session closed for user root
Aug 27 00:49:32 user nova-compute[73458]: INFO oslo.privsep.daemon [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Spawned new privsep daemon via rootwrap
Aug 27 00:49:32 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 00:49:32 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 00:49:32 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 27 00:49:32 user nova-compute[73458]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84129
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26609374-822a-4ac3-814a-586416fa8b5e]: (2,) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425db76-c6b7-498d-af76-acd46f5599b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: WARNING os_brick.initiator.connectors.nvmeof [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607bada-7baf-43f4-a8d4-28ed2f999275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating instance_info_cache with network_info: [{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ab8170-0c20-40c8-a0b6-ec1820513fec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Releasing lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance network_info: |[{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ecf6d-87c7-426e-bd37-1ee7c6b26006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] Acquired lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Refreshing network info cache for port d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:32 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a43f380-9ba4-47c3-b32c-297e198d8c99]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG os_brick.utils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== get_connector_properties: return (2388ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating existing volume attachment record: 44304fcb-0f96-4564-9b58-17b44fc33026 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updated VIF entry in instance network info cache for port d38e00a5-6077-4aa3-bfea-7897c6fa733a. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating instance_info_cache with network_info: [{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a46d8673-aa2b-46bf-bdd5-0d7e7e97b110 req-35f56556-0403-4123-ab97-87c6f5e3c25e service nova] Releasing lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:49:51 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Creating image(s)
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start _get_guest_xml network_info=[{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7492f540-2a69-463c-82f7-9ea78fc6c8a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b153e901-0356-4a3b-964f-3f17ee111a82', 'serial': 'b153e901-0356-4a3b-964f-3f17ee111a82'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '44304fcb-0f96-4564-9b58-17b44fc33026', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:49:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connector [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Factory for ISCSI on None {{(pid=73458) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:49:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:49:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:49:51 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d258e4f-f9c3-446f-a37c-e6211fd0d5d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:49:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d61c553-09a5-4886-b5d3-9a96d5b80862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82] added
Aug 27 00:49:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769c561-c439-4bc0-b04a-d09c39fd7113]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418e897-6120-4e34-a2d8-d567cc7f2063]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQzdXYKu {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQzdXYKu" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[42022a88-f345-4140-8400-99ad0187add8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQzdXYKu'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bdf023-93ea-46c0-872a-6b4d5bbe915f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46eefc6-eff0-466f-a54b-a75f61f69e0d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:49:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 00:49:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:49:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 00:49:51 user nova-compute[73458]: 
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8a755-4f34-4ea9-ba4c-527d9ec7d99e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]
Aug 27 00:49:51 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.
Aug 27 00:49:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf236925-1ac2-4d18-947c-6f44f479c29f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50f3f1-4ebe-4d9d-a553-b9b519d0071a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:49:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:49:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb5dc4-e3f4-4a9e-a191-e654a38abb9c]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:52 user nova-compute[73458]: INFO nova.compute.claims [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Claim successful on node user
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.policy [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcdf4d7863614457b38647daca7f705b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872acb80a3aa45cc904b6a0ecd846a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:52 user nova-compute[73458]: INFO nova.virt.block_device [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Booting with volume ca9a6eb3-46e5-48fc-99ea-976b63e477aa at /dev/vda
Aug 27 00:49:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23437373036623134', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437373036623134', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-394550917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lazy-loading 'pci_devices' on Instance uuid 7492f540-2a69-463c-82f7-9ea78fc6c8a6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:49:52 user nova-compute[73458]:   <uuid>7492f540-2a69-463c-82f7-9ea78fc6c8a6</uuid>
Aug 27 00:49:52 user nova-compute[73458]:   <name>instance-00000008</name>
Aug 27 00:49:52 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:49:52 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:49:52 user nova-compute[73458]:   <metadata>
Aug 27 00:49:52 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:49:52 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:49:52 user nova-compute[73458]:       <nova:name>tempest-ServerActionsV293TestJSON-server-394550917</nova:name>
Aug 27 00:49:52 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:49:51</nova:creationTime>
Aug 27 00:49:52 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:49:52 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:49:52 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:49:52 user nova-compute[73458]:       <nova:owner>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:user uuid="ad6b59eaab96447e885ff14e644aaf5b">tempest-ServerActionsV293TestJSON-1142258299-project-member</nova:user>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:project uuid="7af9bf87985e40759127eaa701c05d67">tempest-ServerActionsV293TestJSON-1142258299</nova:project>
Aug 27 00:49:52 user nova-compute[73458]:       </nova:owner>
Aug 27 00:49:52 user nova-compute[73458]:       <nova:ports>
Aug 27 00:49:52 user nova-compute[73458]:         <nova:port uuid="d38e00a5-6077-4aa3-bfea-7897c6fa733a">
Aug 27 00:49:52 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 00:49:52 user nova-compute[73458]:         </nova:port>
Aug 27 00:49:52 user nova-compute[73458]:       </nova:ports>
Aug 27 00:49:52 user nova-compute[73458]:     </nova:instance>
Aug 27 00:49:52 user nova-compute[73458]:   </metadata>
Aug 27 00:49:52 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:49:52 user nova-compute[73458]:     <system>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="serial">7492f540-2a69-463c-82f7-9ea78fc6c8a6</entry>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="uuid">7492f540-2a69-463c-82f7-9ea78fc6c8a6</entry>
Aug 27 00:49:52 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:49:52 user nova-compute[73458]:     </system>
Aug 27 00:49:52 user nova-compute[73458]:   </sysinfo>
Aug 27 00:49:52 user nova-compute[73458]:   <os>
Aug 27 00:49:52 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:49:52 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:49:52 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:49:52 user nova-compute[73458]:   </os>
Aug 27 00:49:52 user nova-compute[73458]:   <features>
Aug 27 00:49:52 user nova-compute[73458]:     <acpi/>
Aug 27 00:49:52 user nova-compute[73458]:     <apic/>
Aug 27 00:49:52 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:49:52 user nova-compute[73458]:   </features>
Aug 27 00:49:52 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:49:52 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:49:52 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:49:52 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:49:52 user nova-compute[73458]:   </clock>
Aug 27 00:49:52 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:49:52 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:49:52 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:49:52 user nova-compute[73458]:   </cpu>
Aug 27 00:49:52 user nova-compute[73458]:   <devices>
Aug 27 00:49:52 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:49:52 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:49:52 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 00:49:52 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:49:52 user nova-compute[73458]:       <serial>b153e901-0356-4a3b-964f-3f17ee111a82</serial>
Aug 27 00:49:52 user nova-compute[73458]:     </disk>
Aug 27 00:49:52 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:49:52 user nova-compute[73458]:       <mac address="fa:16:3e:94:ee:16"/>
Aug 27 00:49:52 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:52 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:49:52 user nova-compute[73458]:       <target dev="tapd38e00a5-60"/>
Aug 27 00:49:52 user nova-compute[73458]:     </interface>
Aug 27 00:49:52 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:49:52 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6/console.log" append="off"/>
Aug 27 00:49:52 user nova-compute[73458]:     </serial>
Aug 27 00:49:52 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:49:52 user nova-compute[73458]:     <video>
Aug 27 00:49:52 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:49:52 user nova-compute[73458]:     </video>
Aug 27 00:49:52 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:49:52 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:49:52 user nova-compute[73458]:     </rng>
Aug 27 00:49:52 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:49:52 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:49:52 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:49:52 user nova-compute[73458]:     </memballoon>
Aug 27 00:49:52 user nova-compute[73458]:   </devices>
Aug 27 00:49:52 user nova-compute[73458]: </domain>
Aug 27 00:49:52 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-394550917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG os_vif [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG os_brick.utils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38e00a5-60, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd38e00a5-60, col_values=(('external_ids', {'iface-id': 'd38e00a5-6077-4aa3-bfea-7897c6fa733a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:ee:16', 'vm-uuid': '7492f540-2a69-463c-82f7-9ea78fc6c8a6'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a36f97-2b7c-4dfc-ad38-54b84cdf395e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: INFO os_vif [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60')
Aug 27 00:49:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e23733d-29ef-4f62-9add-14b9c225b69b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de65d1-50dd-411f-854a-213cc4b27842]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26903040-edbc-4b0c-863c-a1b408456b66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] No VIF found with MAC fa:16:3e:94:ee:16, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:53 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:49:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4835f0ad-d4db-4f69-8833-a77c8cb778df]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG os_brick.utils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating existing volume attachment record: 048aead4-a8a3-4c72-a0a7-280947fc2cbb {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:49:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Successfully created port: cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:54 user nova-compute[73458]: WARNING nova.compute.manager [req-c0caa0cd-a417-4a30-ac18-e462b514e252 req-b71cddfe-19b6-4e63-8925-20442e727863 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state building and task_state spawning.
Aug 27 00:49:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Successfully updated port: cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing instance network info cache due to event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:49:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance network_info: |[{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097396.5612614, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Resumed (Lifecycle Event)
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance spawned successfully.
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097396.577226, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Started (Lifecycle Event)
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:49:56 user nova-compute[73458]: INFO nova.compute.manager [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Took 28.07 seconds to build instance.
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:49:56 user nova-compute[73458]: WARNING nova.compute.manager [req-c17e2484-f191-492e-bef0-1dd583b7eb70 req-34a24420-8c99-407f-bb13-e6bd92ef0221 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state building and task_state spawning.
Aug 27 00:49:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e87a834b-1533-4412-ad6b-d9c9a961e950 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.528s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updated VIF entry in instance network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:49:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:49:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-301df66d-9027-45cd-bb13-17c230850f97 req-3239fb8c-8a9e-4d23-a5cf-aa9c6743a021 service nova] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:49:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:49:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:49:58 user nova-compute[73458]: INFO nova.compute.claims [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Claim successful on node user
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:49:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:49:59 user nova-compute[73458]: INFO nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Booting with volume c9cd4eff-80a6-4d3c-848c-5dc1bb109038 at /dev/vda
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f6e047-f695-4fb4-be1e-eed13fb54e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.policy [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8b69053519142e79e98924e9c929424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729dc2ba91944395b5210cb5ed43d1ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c878a1-5518-4fce-940f-5d6b995a0655]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[571654ac-23f0-4ea5-bf1c-3f731a19e904]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43192b6a-8fc1-48a8-bfd9-041b49458a65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:49:59 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:49:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ec5a80-9826-4fd6-9362-e3cb9cdf5960]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:49:59 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating existing volume attachment record: 58b406b0-8c68-4956-b18f-a07176b09079 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully created port: eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully created port: d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully created port: b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:02 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully created port: c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully created port: 9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-eeb32caf-3b94-4439-95c7-059a4b58184a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6284d371-f093-4ea2-ac21-467019709e92 req-871814a1-eb95-42b1-adca-472edfa7b229 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: 8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-8273494a-e8c0-4f52-a7bf-1b44497c06fb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port 8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fac5e890-8285-41ec-8327-22353ba51b58 req-bfb73d4f-bfcc-4603-9e9f-86c506c940e3 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: 93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-93581884-34c5-4660-8528-efde56489ce1. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port 93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:50:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Creating image(s)
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Ensure instance console log exists: /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start _get_guest_xml network_info=[{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca9a6eb3-46e5-48fc-99ea-976b63e477aa', 'serial': 'ca9a6eb3-46e5-48fc-99ea-976b63e477aa'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '048aead4-a8a3-4c72-a0a7-280947fc2cbb', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:08 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63f59c0-cc0d-4605-90b5-2b1eeb65837a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:50:08 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5667f389-5afc-4abd-bb76-aa47ddea1d52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa] added
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[300a73dd-a702-4a78-a771-03e7a599833f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2f27a4-7494-4b44-bb18-115a0044d108]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46c1d8f6-17a8-4022-92b5-963d29cfbf31 req-a8be601d-4f29-4e14-bfdb-bddbdc882d5b service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srvNaoiK {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srvNaoiK" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fa2134-4ba0-4edf-9e0a-a8bed351f0c7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srvNaoiK'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb3972e-1761-43d8-b216-1255071a4064]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84fcc55-047e-4084-9770-df08802249db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b17468a-e23a-4fdf-8430-1b9201fa85dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]
Aug 27 00:50:08 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50227f-0521-438e-a288-23f13f25383a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbb1444-020e-4930-92ab-2873acb03bc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:08 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:08 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a94bf-5647-45a1-a02a-6bf46adcec39]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:50:08 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23030306137356331', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030306137356331', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNr9+Bcj55+eAAbtn6uoPjvS3HJqBnQ5GIv/tanXPyPqjUCQh/QGAmuwaVq5tYljoyW+XlYSEJ96JRyHrfTnsoCS2rvs79uH0Anx3qMgM5HtufDcgnnbDLU+IKZ71FgGg==',key_name='tempest-TestShelveInstance-1424313510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:53Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:50:09 user nova-compute[73458]:   <uuid>68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</uuid>
Aug 27 00:50:09 user nova-compute[73458]:   <name>instance-00000009</name>
Aug 27 00:50:09 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:50:09 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:50:09 user nova-compute[73458]:   <metadata>
Aug 27 00:50:09 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:50:09 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:50:09 user nova-compute[73458]:       <nova:name>tempest-TestShelveInstance-server-1612863848</nova:name>
Aug 27 00:50:09 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:50:08</nova:creationTime>
Aug 27 00:50:09 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:50:09 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:50:09 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:50:09 user nova-compute[73458]:       <nova:owner>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:user uuid="bcdf4d7863614457b38647daca7f705b">tempest-TestShelveInstance-1196851470-project-member</nova:user>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:project uuid="872acb80a3aa45cc904b6a0ecd846a24">tempest-TestShelveInstance-1196851470</nova:project>
Aug 27 00:50:09 user nova-compute[73458]:       </nova:owner>
Aug 27 00:50:09 user nova-compute[73458]:       <nova:ports>
Aug 27 00:50:09 user nova-compute[73458]:         <nova:port uuid="cb535f02-3171-47c1-b52a-71ec0b82a909">
Aug 27 00:50:09 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:50:09 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:09 user nova-compute[73458]:       </nova:ports>
Aug 27 00:50:09 user nova-compute[73458]:     </nova:instance>
Aug 27 00:50:09 user nova-compute[73458]:   </metadata>
Aug 27 00:50:09 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:50:09 user nova-compute[73458]:     <system>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="serial">68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</entry>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="uuid">68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</entry>
Aug 27 00:50:09 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:50:09 user nova-compute[73458]:     </system>
Aug 27 00:50:09 user nova-compute[73458]:   </sysinfo>
Aug 27 00:50:09 user nova-compute[73458]:   <os>
Aug 27 00:50:09 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:50:09 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:50:09 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:50:09 user nova-compute[73458]:   </os>
Aug 27 00:50:09 user nova-compute[73458]:   <features>
Aug 27 00:50:09 user nova-compute[73458]:     <acpi/>
Aug 27 00:50:09 user nova-compute[73458]:     <apic/>
Aug 27 00:50:09 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:50:09 user nova-compute[73458]:   </features>
Aug 27 00:50:09 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:50:09 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:50:09 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:50:09 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:50:09 user nova-compute[73458]:   </clock>
Aug 27 00:50:09 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:50:09 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:50:09 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:50:09 user nova-compute[73458]:   </cpu>
Aug 27 00:50:09 user nova-compute[73458]:   <devices>
Aug 27 00:50:09 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:50:09 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:50:09 user nova-compute[73458]:       <source dev="/dev/sdc"/>
Aug 27 00:50:09 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:50:09 user nova-compute[73458]:       <serial>ca9a6eb3-46e5-48fc-99ea-976b63e477aa</serial>
Aug 27 00:50:09 user nova-compute[73458]:     </disk>
Aug 27 00:50:09 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:09 user nova-compute[73458]:       <mac address="fa:16:3e:c1:1d:4c"/>
Aug 27 00:50:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:09 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:09 user nova-compute[73458]:       <target dev="tapcb535f02-31"/>
Aug 27 00:50:09 user nova-compute[73458]:     </interface>
Aug 27 00:50:09 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:50:09 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f/console.log" append="off"/>
Aug 27 00:50:09 user nova-compute[73458]:     </serial>
Aug 27 00:50:09 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:50:09 user nova-compute[73458]:     <video>
Aug 27 00:50:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:09 user nova-compute[73458]:     </video>
Aug 27 00:50:09 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:50:09 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:50:09 user nova-compute[73458]:     </rng>
Aug 27 00:50:09 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:50:09 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:50:09 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:50:09 user nova-compute[73458]:     </memballoon>
Aug 27 00:50:09 user nova-compute[73458]:   </devices>
Aug 27 00:50:09 user nova-compute[73458]: </domain>
Aug 27 00:50:09 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNr9+Bcj55+eAAbtn6uoPjvS3HJqBnQ5GIv/tanXPyPqjUCQh/QGAmuwaVq5tYljoyW+XlYSEJ96JRyHrfTnsoCS2rvs79uH0Anx3qMgM5HtufDcgnnbDLU+IKZ71FgGg==',key_name='tempest-TestShelveInstance-1424313510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:49:53Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG os_vif [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb535f02-31, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb535f02-31, col_values=(('external_ids', {'iface-id': 'cb535f02-3171-47c1-b52a-71ec0b82a909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:1d:4c', 'vm-uuid': '68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:09 user nova-compute[73458]: INFO os_vif [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31')
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] No VIF found with MAC fa:16:3e:c1:1d:4c, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-d566bacb-d803-4100-825b-e11a4179daf2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-b1fa2b4f-da94-416b-a093-731b3a8e404f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:10 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:50:10 user nova-compute[73458]: INFO nova.compute.claims [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Claim successful on node user
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.network.neutron [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f6e7f62-1ff8-460b-937b-856ce271802d req-bdde0f96-0a2a-4d17-9c62-5e2dbb1be536 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Successfully updated port: 9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:11 user nova-compute[73458]: WARNING nova.compute.manager [req-9c3e4281-516b-4b94-a48c-6dff2f6d0d23 req-bcaa0c48-c317-4376-a5a0-6c2cf7d27f17 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state building and task_state spawning.
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:11 user nova-compute[73458]: INFO nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Booting with volume 0a85f40b-c0ce-435e-adbd-64be614ba522 at /dev/vda
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d8609b-4c00-409f-b7aa-f304d8c6c533]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f264e-58e5-43a7-ba13-c2de92778ba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bd7d4a-9bd7-414d-bf26-c51a63d89915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[050bc75b-7c4e-4a19-86d1-d3b56acefa81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.policy [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc13d243d19e49c58823b958b76c20eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ca8d63bdcdc4f14a74b584b42540437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:11 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[05103f73-3064-4c65-bedc-0c80bd715a04]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:11 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating existing volume attachment record: 867201a8-0044-4230-9e22-b4743fe3a3e0 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully created port: f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Booting with volume 3bc5133f-4edd-4410-b8dd-a45d41659f08 at /dev/vdb
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cd2668-186b-4cb0-b223-fd0bd69778da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully created port: cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c43cd7-f858-4a4d-b37f-e1d9577ef37f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a934a-18bd-4923-b6a8-4c3bd4f43969]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a7e890-aa16-4b70-82df-9c80e52179cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:13 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1144f533-d02c-4824-b3e5-362c6008f7f3]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating existing volume attachment record: d560e33b-2686-4bb2-8497-098f486af60c {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097413.6054797, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Resumed (Lifecycle Event)
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance spawned successfully.
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097413.6064339, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Started (Lifecycle Event)
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:13 user nova-compute[73458]: WARNING nova.compute.manager [req-bedce9e2-7c32-4be7-8987-509ed698f008 req-bf0b47b2-05fc-4967-a3a0-ac0d3662f312 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state building and task_state spawning.
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:13 user nova-compute[73458]: INFO nova.compute.manager [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Took 21.83 seconds to build instance.
Aug 27 00:50:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c74615ae-89da-442e-8c17-19ffb25033ce tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.960s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully created port: 3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance network_info: |[{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updated VIF entry in instance network info cache for port c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-9d102021-81e6-4551-9db7-bd7e29adb1b6. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port 9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully created port: 0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully created port: 163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updated VIF entry in instance network info cache for port 9d102021-81e6-4551-9db7-bd7e29adb1b6. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b3b5f08a-5860-4f03-ac67-aafc66e2c341 req-431d0a2f-1e59-4a42-bf3f-a86681b8c7c7 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c5501633-1858-479e-b727-92c3f4b98166 req-6acc01dc-17e3-45e6-a98d-96b1a8836957 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: 6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-fa924b9f-07af-41ed-ac93-d00ae2072e37. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-6f6f8399-2933-4ee4-86ba-8399e29648fb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port 6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG nova.network.neutron [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-146076c8-e2d9-4110-9441-e9c4a5da6450 req-38c21664-c6ee-4830-bf9d-74ea722893c0 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: 3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-cde54ab3-f79c-47ee-9ae6-a1170bd09a86. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port 3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: 0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-38ed9ed3-6be7-41be-a978-fa08b504ad87 req-bc9dbc41-988a-43c6-b88b-8cb831deb5b0 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Successfully updated port: 163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:50:21 user nova-compute[73458]: INFO nova.compute.claims [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Claim successful on node user
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-0d4efb28-7efd-4ad3-a40f-328c99958fc2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:50:23 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:23 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7231MB free_disk=25.780338287353516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.policy [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24e9f78541bc45c48b4e0637f666e9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d6f575c140547d2ae48ed7dea334375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:50:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Creating image(s)
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "/opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "/opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "/opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2546394c-768a-4254-9a63-7cc0b91b6ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9613067b-3440-4584-a2a2-38535e913dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c709b541-1fa2-406e-9210-fbfd4ac870ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2bb72ec0-49d0-492d-b004-c0af11aeed8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b7b683b7-a32c-42ee-9ee0-10bb03611810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2f2d4e39-0c45-448e-add7-f053858edd8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.242s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk 1073741824" returned: 0 in 0.135s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Successfully created port: 40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.016s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.258s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Cannot resize image /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Ensure instance console log exists: /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Successfully updated port: 40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquired lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-changed-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Refreshing instance network info cache due to event network-changed-40bb8258-e61d-4090-83e4-fb73a6839fa6. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] Acquiring lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance network_info: |[{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port 0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lazy-loading 'flavor' on Instance uuid 2bb72ec0-49d0-492d-b004-c0af11aeed8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.109s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:25 user nova-compute[73458]: INFO nova.compute.manager [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Attaching volume 88ab12c5-bee1-461e-900d-424aa55a252e to /dev/vdb
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Updating instance_info_cache with network_info: [{"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Releasing lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Instance network_info: |[{"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] Acquired lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Refreshing network info cache for port 40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Start _get_guest_xml network_info=[{"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:50:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248441373',display_name='tempest-ServersNegativeTestJSON-server-248441373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248441373',id=12,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-qbjs490g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:23Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=2546394c-768a-4254-9a63-7cc0b91b6ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lazy-loading 'pci_devices' on Instance uuid 2546394c-768a-4254-9a63-7cc0b91b6ed8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.utils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updated VIF entry in instance network info cache for port 0d4efb28-7efd-4ad3-a40f-328c99958fc2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:50:25 user nova-compute[73458]:   <uuid>2546394c-768a-4254-9a63-7cc0b91b6ed8</uuid>
Aug 27 00:50:25 user nova-compute[73458]:   <name>instance-0000000c</name>
Aug 27 00:50:25 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:50:25 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:50:25 user nova-compute[73458]:   <metadata>
Aug 27 00:50:25 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:50:25 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:name>tempest-ServersNegativeTestJSON-server-248441373</nova:name>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:50:25</nova:creationTime>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:50:25 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:50:25 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:owner>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:user uuid="24e9f78541bc45c48b4e0637f666e9cd">tempest-ServersNegativeTestJSON-2010218333-project-member</nova:user>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:project uuid="2d6f575c140547d2ae48ed7dea334375">tempest-ServersNegativeTestJSON-2010218333</nova:project>
Aug 27 00:50:25 user nova-compute[73458]:       </nova:owner>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:50:25 user nova-compute[73458]:       <nova:ports>
Aug 27 00:50:25 user nova-compute[73458]:         <nova:port uuid="40bb8258-e61d-4090-83e4-fb73a6839fa6">
Aug 27 00:50:25 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 00:50:25 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:25 user nova-compute[73458]:       </nova:ports>
Aug 27 00:50:25 user nova-compute[73458]:     </nova:instance>
Aug 27 00:50:25 user nova-compute[73458]:   </metadata>
Aug 27 00:50:25 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:50:25 user nova-compute[73458]:     <system>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="serial">2546394c-768a-4254-9a63-7cc0b91b6ed8</entry>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="uuid">2546394c-768a-4254-9a63-7cc0b91b6ed8</entry>
Aug 27 00:50:25 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:50:25 user nova-compute[73458]:     </system>
Aug 27 00:50:25 user nova-compute[73458]:   </sysinfo>
Aug 27 00:50:25 user nova-compute[73458]:   <os>
Aug 27 00:50:25 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:50:25 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:50:25 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:50:25 user nova-compute[73458]:   </os>
Aug 27 00:50:25 user nova-compute[73458]:   <features>
Aug 27 00:50:25 user nova-compute[73458]:     <acpi/>
Aug 27 00:50:25 user nova-compute[73458]:     <apic/>
Aug 27 00:50:25 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:50:25 user nova-compute[73458]:   </features>
Aug 27 00:50:25 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:50:25 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:50:25 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:50:25 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:50:25 user nova-compute[73458]:   </clock>
Aug 27 00:50:25 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:50:25 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:50:25 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:50:25 user nova-compute[73458]:   </cpu>
Aug 27 00:50:25 user nova-compute[73458]:   <devices>
Aug 27 00:50:25 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:50:25 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:50:25 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk"/>
Aug 27 00:50:25 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:50:25 user nova-compute[73458]:     </disk>
Aug 27 00:50:25 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:25 user nova-compute[73458]:       <mac address="fa:16:3e:80:a7:91"/>
Aug 27 00:50:25 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:25 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:25 user nova-compute[73458]:       <target dev="tap40bb8258-e6"/>
Aug 27 00:50:25 user nova-compute[73458]:     </interface>
Aug 27 00:50:25 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:50:25 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/console.log" append="off"/>
Aug 27 00:50:25 user nova-compute[73458]:     </serial>
Aug 27 00:50:25 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:50:25 user nova-compute[73458]:     <video>
Aug 27 00:50:25 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:25 user nova-compute[73458]:     </video>
Aug 27 00:50:25 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:50:25 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:50:25 user nova-compute[73458]:     </rng>
Aug 27 00:50:25 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:50:25 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:50:25 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:50:25 user nova-compute[73458]:     </memballoon>
Aug 27 00:50:25 user nova-compute[73458]:   </devices>
Aug 27 00:50:25 user nova-compute[73458]: </domain>
Aug 27 00:50:25 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248441373',display_name='tempest-ServersNegativeTestJSON-server-248441373',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248441373',id=12,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-qbjs490g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:23Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=2546394c-768a-4254-9a63-7cc0b91b6ed8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_vif [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[da278f18-7959-49cf-955a-c32a52c0c14c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40bb8258-e6, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40bb8258-e6, col_values=(('external_ids', {'iface-id': '40bb8258-e61d-4090-83e4-fb73a6839fa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:a7:91', 'vm-uuid': '2546394c-768a-4254-9a63-7cc0b91b6ed8'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-163386e1-69f4-4959-8de8-ccfa7372d4c6. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port 163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:25 user nova-compute[73458]: INFO os_vif [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6')
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff9fa7-b26d-4a50-9691-c6a91e6ff4a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d453b3-67de-4216-b4c2-4c8ffe818ada]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b1331-f7af-4258-958f-46b74c5d5ecc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:25 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[159a1a51-117b-4f27-be11-a31c4efa9b27]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG os_brick.utils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updating existing volume attachment record: 37ab5cf0-fa18-4006-8b61-ee5ec34e94ac {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] No VIF found with MAC fa:16:3e:80:a7:91, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Updated VIF entry in instance network info cache for port 40bb8258-e61d-4090-83e4-fb73a6839fa6. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Updating instance_info_cache with network_info: [{"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-67ce1f7c-1fcf-4670-a5df-0d7689cb06b4 req-9b6bfff5-ceff-4020-9177-0555ae27c4e0 service nova] Releasing lock "refresh_cache-2546394c-768a-4254-9a63-7cc0b91b6ed8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updated VIF entry in instance network info cache for port 163386e1-69f4-4959-8de8-ccfa7372d4c6. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-615cd28f-25d6-4d1e-b2bd-f0b9bcd35b4a req-91b0b273-2a03-4ec1-8ffe-b5d27b7a0854 service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-changed-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Refreshing instance network info cache due to event network-changed-f4a1c5ef-9fa2-4b59-98a2-1b220f512442. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Refreshing network info cache for port f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:27 user nova-compute[73458]: INFO nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Booting with volume e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 at /dev/vdc
Aug 27 00:50:27 user nova-compute[73458]: DEBUG nova.network.neutron [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updated VIF entry in instance network info cache for port f4a1c5ef-9fa2-4b59-98a2-1b220f512442. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG nova.network.neutron [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-919b851d-9bc4-4ae6-ba6f-fd1a6db0fd53 req-c579fac4-e4f7-4755-84e1-b07eeb93dd99 service nova] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2b8f5-b68b-4347-af22-ea3f041b82e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7e295-9e65-4c7c-98fd-a172b2019b50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5fc69-67cf-49ab-a845-21b3ea293d5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc8aff-f1a2-4faf-b5c7-9d3d994fe58d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:27 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b10a3b-f7bd-4abc-90a7-300264e6bdb7]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG os_brick.utils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:27 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating existing volume attachment record: 0efe33f0-67c4-4d6b-b6db-031bf1f95d35 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] No waiting events found dispatching network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:29 user nova-compute[73458]: WARNING nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received unexpected event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 for instance with vm_state building and task_state spawning.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] No waiting events found dispatching network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:29 user nova-compute[73458]: WARNING nova.compute.manager [req-3d6929b3-3cb6-4156-8ba0-18ef5756c395 req-5e3f4eda-7b44-4ac6-8418-31b14f62ead8 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received unexpected event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 for instance with vm_state building and task_state spawning.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097429.6477485, 2546394c-768a-4254-9a63-7cc0b91b6ed8 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] VM Resumed (Lifecycle Event)
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Instance spawned successfully.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097429.6485639, 2546394c-768a-4254-9a63-7cc0b91b6ed8 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] VM Started (Lifecycle Event)
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Took 6.34 seconds to spawn the instance on the hypervisor.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:29 user nova-compute[73458]: INFO nova.compute.manager [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Took 7.96 seconds to build instance.
Aug 27 00:50:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a9b07f2c-ada1-4e85-9a8c-175e422a99da tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.144s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:34 user nova-compute[73458]: INFO nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Booting with volume da34ba64-594b-47c8-8586-89c26a364005 at /dev/vdb
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8eb241-7ef9-4b11-9e1b-872c74eb08b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d48ab7-99b1-43f4-8080-ff7da325eb47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef64d85-a50f-47c1-83b1-ae37f73b4a93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9740ee62-21be-4ec3-b479-923acdbfeff6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:35 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a3aa6-4a90-4838-b3b7-9a8977da4198]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating existing volume attachment record: ce582f98-eeec-45d4-abae-a29f70051c77 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvwnmXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:39 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f9106-c85a-4e5c-b57d-2b3ba2f94102]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:50:39 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769a9f2-7c23-4e2b-8912-d21327581d08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e] added
Aug 27 00:50:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc70b66-a3aa-45c3-9192-259763b7bb92]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0b4998-a088-4ada-a564-0117bb52e6eb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvwnmXBW {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvwnmXBW" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb872a6f-2151-4275-af28-3c3e09f6997d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvwnmXBW'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b2a09-1876-4236-a240-511fd0cc87e6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec1086-a52d-42f1-a46b-b3e1c5979468]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:39 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:39 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --login" returned: 0 in 1.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8fe52d-67c1-4449-96a8-12fdf74a1268]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260]
Aug 27 00:50:40 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82df2032-26b8-44ae-8902-fa68ff6ba7a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68cef87-ae81-48d0-bf3a-ba1251952e8c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:40 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:40 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:40 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:40 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.306s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9b9676-464f-4803-bded-82bcfa552aba]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:50:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Creating image(s)
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Ensure instance console log exists: /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Start _get_guest_xml network_info=[{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfdzBFwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9cd4eff-80a6-4d3c-848c-5dc1bb109038', 'serial': 'c9cd4eff-80a6-4d3c-848c-5dc1bb109038'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '58b406b0-8c68-4956-b18f-a07176b09079', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFazAej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f', 'attached_at': '', 'detached_at': '', 'volume_id': '3bc5133f-4edd-4410-b8dd-a45d41659f08', 'serial': '3bc5133f-4edd-4410-b8dd-a45d41659f08'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'd560e33b-2686-4bb2-8497-098f486af60c', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvFVyCTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3', 'serial': 'e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '0efe33f0-67c4-4d6b-b6db-031bf1f95d35', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:50:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfdzBFwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:41 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvwnmXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.340s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] <== connect_volume: return (2341ms) {'type': 'block', 'scsi_wwn': '23834616164303935', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834616164303935', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.469s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:41 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:41 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lazy-loading 'flavor' on Instance uuid 2bb72ec0-49d0-492d-b004-c0af11aeed8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e060a94-815a-45a0-b414-990f7f8a0902]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:50:41 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b52a4b-64d2-4304-9961-ce99b01e4d27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038] added
Aug 27 00:50:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:50:41 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:50:41 user nova-compute[73458]:   <source dev="/dev/sdd"/>
Aug 27 00:50:41 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:50:41 user nova-compute[73458]:   <serial>88ab12c5-bee1-461e-900d-424aa55a252e</serial>
Aug 27 00:50:41 user nova-compute[73458]: </disk>
Aug 27 00:50:41 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e604ec2-805d-423d-a5b1-6e0a3218bdd5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7fb1f-ed20-49f6-94fd-eb56bd108deb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfdzBFwe {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfdzBFwe" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b53422-1b75-4ca0-aac1-3ba18fe234ea]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfdzBFwe'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757792c-c9db-4f4c-8cc1-e10ab8ff70a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86700d2d-5311-4020-9eeb-0923c7a5cdfb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:41 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:41 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:41 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:41 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb933fa2-995d-4641-8ce6-40bc3ac87f53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260]
Aug 27 00:50:41 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[036cf3f2-4609-4eec-a938-0d0e809b082e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[803cafc5-6c76-4927-8047-ecf53ac6cbf2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:42 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:42 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:42 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f6d791-3f19-438a-91dc-65317a8fa0d0]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfdzBFwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] No VIF found with MAC fa:16:3e:59:4e:15, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6026e64-df86-4421-870d-051538b73233 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.999s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:42 user nova-compute[73458]: INFO nova.compute.manager [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Terminating instance
Aug 27 00:50:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== connect_volume: return (1815ms) {'type': 'block', 'scsi_wwn': '23336346138633566', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336346138633566', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFazAej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:43 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:43 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:43 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cde4e6-c6fb-4a75-bdde-388c908c50e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:50:43 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db045b43-3184-4785-9865-43566a94f307]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08] added
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[335dd3e9-437a-4240-9736-0e076f3cc592]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b447af6-ba0d-428a-8e27-fa2fb8ed6cd9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcFazAej {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcFazAej" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67855442-a467-4578-8ee8-8a24aed33795]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcFazAej'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e645c94a-ec57-420b-9e05-96696147866f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[84973510-a6d9-4162-896c-f8dd200745dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-unplugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] No waiting events found dispatching network-vif-unplugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8b93404-9cfd-4a30-ad31-a8196757e5c7 req-59b88628-36a9-4318-9ca4-34ae73c73ec9 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-unplugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[85beeabd-2b5b-4416-9efa-6b5d214cf2fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260]
Aug 27 00:50:43 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92510e5b-796d-4ddc-b336-26fdeb9cca8f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0ba25-d530-4fa4-b274-55b29616e38d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9589f9-61ce-488c-b0d8-3f00f907ba0f]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFazAej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:50:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Instance destroyed successfully.
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lazy-loading 'resources' on Instance uuid 2bb72ec0-49d0-492d-b004-c0af11aeed8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1941822667',display_name='tempest-DeleteServersTestJSON-server-1941822667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1941822667',id=1,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad18e0f41df146e382f6524daa86a75d',ramdisk_id='',reservation_id='r-2jqld5jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1353834451',owner_user_name='tempest-DeleteServersTestJSON-1353834451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:48:47Z,user_data=None,user_id='0df48c36952f4b4581209d4cde322dbe',uuid=2bb72ec0-49d0-492d-b004-c0af11aeed8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converting VIF {"id": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "address": "fa:16:3e:59:4e:15", "network": {"id": "ec7dd1b4-0ade-401a-ab84-971b449438ac", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1051171663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad18e0f41df146e382f6524daa86a75d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f75f6c-f8", "ovs_interfaceid": "c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_vif [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f75f6c-f8, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:43 user nova-compute[73458]: INFO os_vif [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:4e:15,bridge_name='br-int',has_traffic_filtering=True,id=c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f,network=Network(ec7dd1b4-0ade-401a-ab84-971b449438ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f75f6c-f8')
Aug 27 00:50:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvwnmXBW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:43 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23732323762663533', 'path': '/dev/sdf'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732323762663533', 'path': '/dev/sdf'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.754s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc5e8fc-cdb0-437f-a636-c8248c2ea54f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.168s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65fd694-cb55-4c60-8feb-fc651b26e324]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e980da170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvFVyCTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[83815fd6-57be-4032-a0b4-110d08a89528]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc812e7c-b8b6-400a-9b01-f183213868b6]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc70113-ad0c-4f12-973d-f43449a06eaa]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54dce08-a6b3-4696-99c2-d119570d5323]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c144a4-def0-428f-9c5a-f078f4525bd8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea2ac38-4349-47cc-a3c5-f40ded817e20]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260]
Aug 27 00:50:45 user nova-compute[73458]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88ab12c5-bee1-461e-900d-424aa55a252e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1346a8d-a13d-4b6a-9dcd-6bee20dcbbc8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] <== disconnect_volume: return (1199ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:50:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Deleting instance files /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c_del
Aug 27 00:50:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Deletion of /opt/stack/data/nova/instances/2bb72ec0-49d0-492d-b004-c0af11aeed8c_del complete
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.250s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:50:45 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[237af4c4-72d9-402e-a377-38014063cfea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:50:45 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0266d0-8ad2-417f-9273-3fd4b4624797]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3] added
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb129da-de68-4b1f-9855-430c05f7bdb4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f9649-3322-4fd6-9140-9d3d8910cb52]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvFVyCTW {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73458) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 27 00:50:45 user nova-compute[73458]: INFO nova.virt.libvirt.host [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] UEFI support detected
Aug 27 00:50:45 user nova-compute[73458]: INFO nova.compute.manager [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Took 2.17 seconds to destroy the instance on the hypervisor.
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvFVyCTW" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[06adeead-ad46-44bc-aaae-37adb478d6f9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wvFVyCTW'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[898fa9f5-11b5-4f02-99ee-f4be2e929b5d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98f344-267c-4084-8fac-be4196e31c19]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79005306-694d-42f8-bf93-0ab81f18e39f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260]
Aug 27 00:50:45 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260] successful.
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54b7c9-b196-4bbf-bb64-09760cc4922e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05cf84-a8fb-497b-b93d-edd8321c86ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:50:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3a831a-5791-41fa-ba67-5a4939bbc726]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvFVyCTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] Acquiring lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] No waiting events found dispatching network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:45 user nova-compute[73458]: WARNING nova.compute.manager [req-8f7aead6-78fa-463f-a392-fa14aa9fea83 req-21923019-f941-4867-bddc-7f4dd79e16a4 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received unexpected event network-vif-plugged-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f for instance with vm_state active and task_state deleting.
Aug 27 00:50:45 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:45 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Took 0.79 seconds to deallocate network for instance.
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '26439316132383738', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439316132383738', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lazy-loading 'pci_devices' on Instance uuid eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:50:46 user nova-compute[73458]:   <uuid>eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f</uuid>
Aug 27 00:50:46 user nova-compute[73458]:   <name>instance-0000000a</name>
Aug 27 00:50:46 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:50:46 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:50:46 user nova-compute[73458]:   <metadata>
Aug 27 00:50:46 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:50:46 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:name>tempest-device-tagging-server-1419851038</nova:name>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:50:41</nova:creationTime>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:50:46 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:50:46 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:owner>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:user uuid="d8b69053519142e79e98924e9c929424">tempest-TaggedBootDevicesTest_v242-354487124-project-member</nova:user>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:project uuid="729dc2ba91944395b5210cb5ed43d1ea">tempest-TaggedBootDevicesTest_v242-354487124</nova:project>
Aug 27 00:50:46 user nova-compute[73458]:       </nova:owner>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:50:46 user nova-compute[73458]:       <nova:ports>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="eeb32caf-3b94-4439-95c7-059a4b58184a">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="8273494a-e8c0-4f52-a7bf-1b44497c06fb">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="93581884-34c5-4660-8528-efde56489ce1">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="d566bacb-d803-4100-825b-e11a4179daf2">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="b1fa2b4f-da94-416b-a093-731b3a8e404f">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.50" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:         <nova:port uuid="9d102021-81e6-4551-9db7-bd7e29adb1b6">
Aug 27 00:50:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 00:50:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:50:46 user nova-compute[73458]:       </nova:ports>
Aug 27 00:50:46 user nova-compute[73458]:     </nova:instance>
Aug 27 00:50:46 user nova-compute[73458]:   </metadata>
Aug 27 00:50:46 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:50:46 user nova-compute[73458]:     <system>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="serial">eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f</entry>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="uuid">eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f</entry>
Aug 27 00:50:46 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:50:46 user nova-compute[73458]:     </system>
Aug 27 00:50:46 user nova-compute[73458]:   </sysinfo>
Aug 27 00:50:46 user nova-compute[73458]:   <os>
Aug 27 00:50:46 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:50:46 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:50:46 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:50:46 user nova-compute[73458]:   </os>
Aug 27 00:50:46 user nova-compute[73458]:   <features>
Aug 27 00:50:46 user nova-compute[73458]:     <acpi/>
Aug 27 00:50:46 user nova-compute[73458]:     <apic/>
Aug 27 00:50:46 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:50:46 user nova-compute[73458]:   </features>
Aug 27 00:50:46 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:50:46 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:50:46 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:50:46 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:50:46 user nova-compute[73458]:   </clock>
Aug 27 00:50:46 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:50:46 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:50:46 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:50:46 user nova-compute[73458]:   </cpu>
Aug 27 00:50:46 user nova-compute[73458]:   <devices>
Aug 27 00:50:46 user nova-compute[73458]:     <disk type="file" device="cdrom">
Aug 27 00:50:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 00:50:46 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/disk.config"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="hda" bus="ide"/>
Aug 27 00:50:46 user nova-compute[73458]:     </disk>
Aug 27 00:50:46 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:50:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:50:46 user nova-compute[73458]:       <source dev="/dev/sde"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <serial>c9cd4eff-80a6-4d3c-848c-5dc1bb109038</serial>
Aug 27 00:50:46 user nova-compute[73458]:     </disk>
Aug 27 00:50:46 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:50:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:50:46 user nova-compute[73458]:       <source dev="/dev/sdf"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <serial>3bc5133f-4edd-4410-b8dd-a45d41659f08</serial>
Aug 27 00:50:46 user nova-compute[73458]:     </disk>
Aug 27 00:50:46 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:50:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:50:46 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="vdc" bus="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <serial>e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3</serial>
Aug 27 00:50:46 user nova-compute[73458]:     </disk>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:a6:1d:8c"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tapeeb32caf-3b"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:c6:04:d9"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tap8273494a-e8"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:c3:d5:ef"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tap93581884-34"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:10:db:e1"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tapd566bacb-d8"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:64:bb:4d"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tapb1fa2b4f-da"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:b1:4c:05"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tapc8d6a41a-f0"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:50:46 user nova-compute[73458]:       <mac address="fa:16:3e:99:bd:89"/>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:50:46 user nova-compute[73458]:       <target dev="tap9d102021-81"/>
Aug 27 00:50:46 user nova-compute[73458]:     </interface>
Aug 27 00:50:46 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:50:46 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/console.log" append="off"/>
Aug 27 00:50:46 user nova-compute[73458]:     </serial>
Aug 27 00:50:46 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:50:46 user nova-compute[73458]:     <video>
Aug 27 00:50:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:50:46 user nova-compute[73458]:     </video>
Aug 27 00:50:46 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:50:46 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:50:46 user nova-compute[73458]:     </rng>
Aug 27 00:50:46 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:50:46 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:50:46 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:50:46 user nova-compute[73458]:     </memballoon>
Aug 27 00:50:46 user nova-compute[73458]:   </devices>
Aug 27 00:50:46 user nova-compute[73458]: </domain>
Aug 27 00:50:46 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb32caf-3b, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeb32caf-3b, col_values=(('external_ids', {'iface-id': 'eeb32caf-3b94-4439-95c7-059a4b58184a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:1d:8c', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8273494a-e8, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8273494a-e8, col_values=(('external_ids', {'iface-id': '8273494a-e8c0-4f52-a7bf-1b44497c06fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:04:d9', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93581884-34, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap93581884-34, col_values=(('external_ids', {'iface-id': '93581884-34c5-4660-8528-efde56489ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:d5:ef', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd566bacb-d8, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd566bacb-d8, col_values=(('external_ids', {'iface-id': 'd566bacb-d803-4100-825b-e11a4179daf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:db:e1', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1fa2b4f-da, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1fa2b4f-da, col_values=(('external_ids', {'iface-id': 'b1fa2b4f-da94-416b-a093-731b3a8e404f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:bb:4d', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8d6a41a-f0, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8d6a41a-f0, col_values=(('external_ids', {'iface-id': 'c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:4c:05', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d102021-81, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d102021-81, col_values=(('external_ids', {'iface-id': '9d102021-81e6-4551-9db7-bd7e29adb1b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:bd:89', 'vm-uuid': 'eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:46 user nova-compute[73458]: INFO os_vif [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81')
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] No BDM found with device name hda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] No VIF found with MAC fa:16:3e:a6:1d:8c, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] No VIF found with MAC fa:16:3e:64:bb:4d, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Using config drive
Aug 27 00:50:46 user nova-compute[73458]: INFO nova.compute.manager [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Took 0.96 seconds to detach 1 volumes for instance.
Aug 27 00:50:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Creating config drive at /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/disk.config
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvq87e2z9 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvq87e2z9" returned: 0 in 0.057s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:47 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Deleted allocations for instance 2bb72ec0-49d0-492d-b004-c0af11aeed8c
Aug 27 00:50:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3d450189-1bfe-4c8f-a31a-9ae787397bf9 tempest-DeleteServersTestJSON-1353834451 tempest-DeleteServersTestJSON-1353834451-project-member] Lock "2bb72ec0-49d0-492d-b004-c0af11aeed8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.644s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-917ecc86-92d3-46ef-8c24-40516096ab47 req-501b0775-0734-40e7-a7ef-6d92451f6282 service nova] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Received event network-vif-deleted-c3f75f6c-f8d4-41ba-ac01-0dd2d103e45f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:49 user nova-compute[73458]: WARNING nova.compute.manager [req-ff95c7df-b67b-4d0d-86b8-06d348621c50 req-75d28bf1-36ca-4340-889e-8b0ea1746ee0 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb for instance with vm_state building and task_state spawning.
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:49 user nova-compute[73458]: WARNING nova.compute.manager [req-da743162-306d-43f2-a706-98bd01e08e39 req-da3ac8c6-416f-40aa-8b4a-72da46487e3c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 for instance with vm_state building and task_state spawning.
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:49 user nova-compute[73458]: WARNING nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a for instance with vm_state building and task_state spawning.
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:49 user nova-compute[73458]: WARNING nova.compute.manager [req-2b003f4b-9305-48b6-b78c-0cd971e7e920 req-bcc0e8de-1b19-46c6-9c5d-1abdb9daa9b5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a for instance with vm_state building and task_state spawning.
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-2c1534c8-b757-4705-8101-98388f71c26a req-17c698f6-a6e2-4c5f-b883-bfb512ed02f2 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-changed-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Refreshing instance network info cache due to event network-changed-3685bf83-03cd-4f89-bffc-e6c1f74dde2f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Acquiring lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Acquired lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Refreshing network info cache for port 3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 for instance with vm_state building and task_state spawning.
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:51 user nova-compute[73458]: WARNING nova.compute.manager [req-235b0004-319e-4575-91d9-82a27e5b0fe5 req-047a8a1d-4a57-44bd-b251-c44bacc88ca8 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 for instance with vm_state building and task_state spawning.
Aug 27 00:50:52 user nova-compute[73458]: DEBUG nova.network.neutron [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updated VIF entry in instance network info cache for port 3685bf83-03cd-4f89-bffc-e6c1f74dde2f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:52 user nova-compute[73458]: DEBUG nova.network.neutron [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updating instance_info_cache with network_info: [{"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d400c54f-8b1d-4377-acf0-8b2d95a7ec14 req-b5a61074-22c3-49ae-8233-cff95c792833 service nova] Releasing lock "refresh_cache-9613067b-3440-4584-a2a2-38535e913dce" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097453.0456526, eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] VM Resumed (Lifecycle Event)
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance spawned successfully.
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097453.051164, eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] VM Started (Lifecycle Event)
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Took 12.02 seconds to spawn the instance on the hypervisor.
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.compute.manager [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Took 54.51 seconds to build instance.
Aug 27 00:50:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6de8e2c3-0d07-4581-a314-170fba6b40bf tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.657s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-changed-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing instance network info cache due to event network-changed-0c2bca75-976d-49fe-a789-30aacb954db8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.network.neutron [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing network info cache for port 0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'pci_requests' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.objects.base [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Object Instance<2f2d4e39-0c45-448e-add7-f053858edd8c> lazy-loaded attributes: flavor,pci_requests {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:50:53 user nova-compute[73458]: INFO nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Booting with volume 96c1d4e1-22ed-4297-a662-35307fdedb60 at /dev/vdc
Aug 27 00:50:53 user nova-compute[73458]: DEBUG nova.policy [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a77564556f9e41ff9bbe4e77d9c08c4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f191e470513741d7b951be664ca14122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[45630f8b-4b42-4fc7-88b2-c9b91c68bbe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d55f1b-540d-4384-845f-45c20302c44e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af5631-3168-4644-ad4f-462c9e355911]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae28ce1-a7f5-44b3-b4c5-fe982fabbc88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:54 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a2023-7265-4b90-b263-1dc58f5b9915]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG os_brick.utils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating existing volume attachment record: bb46250c-cbb3-4540-b236-9e9b385bdf89 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updated VIF entry in instance network info cache for port 0c2bca75-976d-49fe-a789-30aacb954db8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-65b6c33d-ba65-40a8-a1dc-81e9702aba6a req-666f209b-c9f5-466d-b40d-82520d815076 service nova] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Successfully created port: 297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Successfully updated port: 297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-changed-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing instance network info cache due to event network-changed-297cf87f-2f0f-4e71-be86-bae4e65887eb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:50:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.objects.instance [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lazy-loading 'flavor' on Instance uuid 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:56 user nova-compute[73458]: INFO nova.compute.manager [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Attaching volume d77b8e77-4840-4c27-8ca0-919cbd929159 to /dev/sdc
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0f5ce-0b46-41b2-a225-27bc9a179764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7692631d-2391-4e94-93b5-270084b5c28f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417d978-23e9-411b-aad4-68cc7618e948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d673d840-4619-499d-80e2-740d9659bedd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:56 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68da9fb-a3a5-4c16-809c-26b0aa57b87c]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updating existing volume attachment record: f33e26a5-b2f8-45f5-abf4-06e627030ff6 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Refreshing network info cache for port 297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG os_vif [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap297cf87f-2f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap297cf87f-2f, col_values=(('external_ids', {'iface-id': '297cf87f-2f0f-4e71-be86-bae4e65887eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:5c:71', 'vm-uuid': '2f2d4e39-0c45-448e-add7-f053858edd8c'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:56 user nova-compute[73458]: INFO os_vif [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f')
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] attach device xml: <interface type="ethernet">
Aug 27 00:50:56 user nova-compute[73458]:   <mac address="fa:16:3e:c3:5c:71"/>
Aug 27 00:50:56 user nova-compute[73458]:   <model type="virtio"/>
Aug 27 00:50:56 user nova-compute[73458]:   <mtu size="1442"/>
Aug 27 00:50:56 user nova-compute[73458]:   <target dev="tap297cf87f-2f"/>
Aug 27 00:50:56 user nova-compute[73458]: </interface>
Aug 27 00:50:56 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:50:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:57 user nova-compute[73458]: WARNING nova.compute.manager [req-e1a3faf9-b7d4-4380-8d75-62cbc1f19ef3 req-d7653ad6-2e36-4d24-bea9-31cc4784288e service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb for instance with vm_state active and task_state None.
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name hda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No VIF found with MAC fa:16:3e:4b:0e:c3, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:50:57 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:50:57</nova:creationTime>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:50:57 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:50:57 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:owner>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:50:57 user nova-compute[73458]:   </nova:owner>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:50:57 user nova-compute[73458]:   <nova:ports>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:50:57 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:50:57 user nova-compute[73458]:     </nova:port>
Aug 27 00:50:57 user nova-compute[73458]:     <nova:port uuid="297cf87f-2f0f-4e71-be86-bae4e65887eb">
Aug 27 00:50:57 user nova-compute[73458]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
Aug 27 00:50:57 user nova-compute[73458]:     </nova:port>
Aug 27 00:50:57 user nova-compute[73458]:   </nova:ports>
Aug 27 00:50:57 user nova-compute[73458]: </nova:instance>
Aug 27 00:50:57 user nova-compute[73458]:  {{(pid=73458) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-edef7f8b-1872-4f9c-a421-054c1c5d5fdd tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.976s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updated VIF entry in instance network info cache for port 297cf87f-2f0f-4e71-be86-bae4e65887eb. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a322eb5-65d5-4cdc-ae73-0dbdfeddad04 req-6bfdee0f-4011-4258-9b4f-06f27e14dca5 service nova] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:50:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:58 user nova-compute[73458]: INFO nova.compute.manager [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Attaching volume fd593c83-448c-4c7e-8730-5cbad3ceef29 to /dev/vdb
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.utils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf13fbb-43c5-4bfa-8e57-84024a7b7d8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b23da-d262-489e-879e-50a36d43658f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b29ea6-23f9-4a52-bd15-6dd81e9c9ed7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67298760-ae15-474e-b1d0-3762784fbcfa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:50:58 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:50:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e8c1a-50ed-4131-9817-072c3401a683]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG os_brick.utils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating existing volume attachment record: 8779e782-9db8-40d0-aa7f-b229e66cc6dc {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:50:58 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097443.7790654, 2bb72ec0-49d0-492d-b004-c0af11aeed8c => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:50:58 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] VM Stopped (Lifecycle Event)
Aug 27 00:50:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2b17c561-e03e-44e2-b160-c0440f0966e6 None None] [instance: 2bb72ec0-49d0-492d-b004-c0af11aeed8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:50:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:50:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:50:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:50:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:50:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:50:59 user nova-compute[73458]: WARNING nova.compute.manager [req-9a103e2d-b1d0-4e8c-8834-e0149756777b req-bf0692ec-5207-4321-bffd-2cb5af418c46 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb for instance with vm_state active and task_state None.
Aug 27 00:51:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-changed-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Refreshing instance network info cache due to event network-changed-7e8414ef-1dbd-4753-bb49-b5291bb84ad8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] Acquiring lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] Acquired lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Refreshing network info cache for port 7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updated VIF entry in instance network info cache for port 7e8414ef-1dbd-4753-bb49-b5291bb84ad8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating instance_info_cache with network_info: [{"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d466bcd2-3b27-4776-9265-00b5c1d131fb req-14d0f0fe-26a9-4893-a755-15543fe21df8 service nova] Releasing lock "refresh_cache-b7b683b7-a32c-42ee-9ee0-10bb03611810" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-changed-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Refreshing instance network info cache due to event network-changed-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:51:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] Acquiring lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] Acquired lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Refreshing network info cache for port 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:51:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updated VIF entry in instance network info cache for port 2076d0b7-1bdf-4797-8f8e-da4ab2c9a653. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:51:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updating instance_info_cache with network_info: [{"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-44fff002-a980-4bf0-9ce6-9eaf91ce489b req-010ebea2-8f08-4cf6-8e96-58516b54b08d service nova] Releasing lock "refresh_cache-c709b541-1fa2-406e-9210-fbfd4ac870ac" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeOwUdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:10 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:10 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:10 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ab8e8-7e09-487f-9b5e-b507a8fe0ef1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:10 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3541b9cd-d9ee-4ecd-9a24-8b6dc0fe4a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159] added
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2b634-902e-4f62-9f43-0233d99241dc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a7d285-f423-4fdb-ba8c-8c09c07f5e72]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeOwUdxm {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeOwUdxm" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed8c1d3-fd48-4b6e-ab15-27e7fa4f0352]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeOwUdxm'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9e781a-bb82-4526-84e3-65ea947903d0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac54cd-2bac-4246-96ac-64644a767cc9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lazy-loading 'flavor' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lazy-loading 'flavor' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1a5882-94cf-4e8d-8aa0-06aab8833c45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260]
Aug 27 00:51:10 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7905fa7-6ca4-4841-9ca4-5541c586cf3c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1f14c-e4ce-4087-b808-90142f931f77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:10 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f420b634-1471-4804-8e0f-274c79b347a0]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeOwUdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:10 user nova-compute[73458]: INFO nova.compute.manager [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Attaching volume 4533d4d6-a465-4748-9e74-6f73ecc08de1 to /dev/vdb
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:11 user nova-compute[73458]: INFO nova.compute.manager [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attaching volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 to /dev/vdb
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb15e9da-3127-4a7f-91ae-1dfa01ed9d17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dbe470-683e-4a14-b0b5-6785b4ff545d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce43a1c-5d27-4420-bc5a-5d35834e31b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dc0f1c-fcef-4e2f-b450-4ea2e91f2a1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4767569-79cb-407a-93f0-57ba6b5bf99a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6ebba2-d937-41e3-9d06-12e167434514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:11 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[982b4512-7a26-4313-9dfc-f3a3d6cb8ce3]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating existing volume attachment record: 8879b78f-e71b-4dcb-af30-bc1cf297bef6 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae43034-f492-46fa-b9ef-97f89d513b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[141f7a35-08e0-44fa-bb10-c29f76c4bfc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:11 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:51:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[468d484b-1c7e-4089-9bc2-4aff3d2f3b6d]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.utils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updating existing volume attachment record: e672fe87-ba92-4b33-8c7c-40e0e838a352 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26633373263613234', 'path': '/dev/sdg'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633373263613234', 'path': '/dev/sdg'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lazy-loading 'flavor' on Instance uuid 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:51:11 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:11 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 00:51:11 user nova-compute[73458]:   <target dev="sdc" bus="scsi"/>
Aug 27 00:51:11 user nova-compute[73458]:   <serial>d77b8e77-4840-4c27-8ca0-919cbd929159</serial>
Aug 27 00:51:11 user nova-compute[73458]:   <address type="drive" controller="0" unit="2"/>
Aug 27 00:51:11 user nova-compute[73458]: </disk>
Aug 27 00:51:11 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No BDM found with device name sda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] No VIF found with MAC fa:16:3e:3c:80:d2, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upzgTPGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:12 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:12 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:12 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab8ee0-079b-46c3-9bc5-39b6dd64573e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:12 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1db84-437b-45a4-a027-bce5d315b0d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29] added
Aug 27 00:51:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e7d430-13ca-47fa-8552-b33c6ae67ab0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198a5b7-0cca-43b5-98ff-cc8a8ebb68b9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upzgTPGo {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upzgTPGo" returned: 0 in 0.081s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6c8e2-8a99-4b8e-90cc-cbf64b1229bd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upzgTPGo'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cfedc1-0dcf-4074-831e-5f084fba1472]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b836cf3-2102-4e83-90af-f1b90c68cd32]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b190ffb2-d399-4651-8d9a-fd592eaf426d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260]
Aug 27 00:51:12 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[476ac3a6-b523-4d92-8cfe-6449e1106f45]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4bd356-8186-4a26-8d3b-1f5b7d26e87d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:13 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139ed21-8dbf-487e-86ed-18a410d3d5af]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upzgTPGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26136346434383132', 'path': '/dev/sdh'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136346434383132', 'path': '/dev/sdh'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:51:14 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:14 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 00:51:14 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:14 user nova-compute[73458]:   <serial>fd593c83-448c-4c7e-8730-5cbad3ceef29</serial>
Aug 27 00:51:14 user nova-compute[73458]: </disk>
Aug 27 00:51:14 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No BDM found with device name hda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] No VIF found with MAC fa:16:3e:4b:0e:c3, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:51:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-changed-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Refreshing instance network info cache due to event network-changed-d38e00a5-6077-4aa3-bfea-7897c6fa733a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] Acquiring lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] Acquired lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG nova.network.neutron [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Refreshing network info cache for port d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updated VIF entry in instance network info cache for port d38e00a5-6077-4aa3-bfea-7897c6fa733a. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating instance_info_cache with network_info: [{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b8fc45-1f14-402d-bcf3-ba270ec1d188 req-4ea06919-afb2-4a13-9cce-788f4820f8e6 service nova] Releasing lock "refresh_cache-7492f540-2a69-463c-82f7-9ea78fc6c8a6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdg (sdc) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:51:22 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:51:22 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=25.766010284423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9613067b-3440-4584-a2a2-38535e913dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2f2d4e39-0c45-448e-add7-f053858edd8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b7b683b7-a32c-42ee-9ee0-10bb03611810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c709b541-1fa2-406e-9210-fbfd4ac870ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2546394c-768a-4254-9a63-7cc0b91b6ed8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:51:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-568be88a-4f4b-4f32-a21d-65f578e05c15 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.287s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f7e2735-82df-4f6f-9a63-358e55998f33 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.471s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:51:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Creating image(s)
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Ensure instance console log exists: /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Start _get_guest_xml network_info=[{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcmzqgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cc46c0f-ed32-4ad4-acea-c91399a3d883', 'attached_at': '', 'detached_at': '', 'volume_id': '0a85f40b-c0ce-435e-adbd-64be614ba522', 'serial': '0a85f40b-c0ce-435e-adbd-64be614ba522'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '867201a8-0044-4230-9e22-b4743fe3a3e0', 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfgDjSvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cc46c0f-ed32-4ad4-acea-c91399a3d883', 'attached_at': '', 'detached_at': '', 'volume_id': 'da34ba64-594b-47c8-8586-89c26a364005', 'serial': 'da34ba64-594b-47c8-8586-89c26a364005'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'ce582f98-eeec-45d4-abae-a29f70051c77', 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxCyzVju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cc46c0f-ed32-4ad4-acea-c91399a3d883', 'attached_at': '', 'detached_at': '', 'volume_id': '96c1d4e1-22ed-4297-a662-35307fdedb60', 'serial': '96c1d4e1-22ed-4297-a662-35307fdedb60'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'bb46250c-cbb3-4540-b236-9e9b385bdf89', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:51:24 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:51:24 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcmzqgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:24 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:24 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:24 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e338130-96ab-47e8-98c1-152f386f294d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:24 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd6da9a-2741-438c-90b8-916081f11ac0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522] added
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dae4bf-2382-414e-8611-96ed4a5cd1af]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c92b7f-fd5e-4528-aeac-c0bb7e41efa3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVcmzqgU {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVcmzqgU" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c5cdc-5d5a-43bd-abd0-73f5f6c74ec6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVcmzqgU'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3298196-bff3-4529-a483-c298402acce7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d6bbb-fc0d-4436-994e-5e8e2ea003ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2384109f-8fea-4983-afc8-abc499e4d5a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260]
Aug 27 00:51:24 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da75566-f628-47da-b475-0bedea130a5e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f07f4e-db83-482f-8cec-4f1347ecd5d5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f7e69d-dccc-484e-bed5-7b5ba5664dc5]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcmzqgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiwISVOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:24 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:24 user nova-compute[73458]: INFO nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Rebuilding instance
Aug 27 00:51:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:25 user nova-compute[73458]: WARNING nova.compute.manager [req-afa5c7b9-a0ba-4f78-977e-426a5675026a req-b79c4085-2993-422f-8508-82aa25500d4e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state rebuilding.
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.compute.manager [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Detaching volume d77b8e77-4840-4c27-8ca0-919cbd929159
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.virt.block_device [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Attempting to driver detach volume d77b8e77-4840-4c27-8ca0-919cbd929159 from mountpoint /dev/sdc
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Attempting to detach device sdc from instance 9613067b-3440-4584-a2a2-38535e913dce from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:25 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:25 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 00:51:25 user nova-compute[73458]:   <target dev="sdc" bus="scsi"/>
Aug 27 00:51:25 user nova-compute[73458]:   <serial>d77b8e77-4840-4c27-8ca0-919cbd929159</serial>
Aug 27 00:51:25 user nova-compute[73458]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 00:51:25 user nova-compute[73458]: </disk>
Aug 27 00:51:25 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Successfully detached device sdc from instance 9613067b-3440-4584-a2a2-38535e913dce from the persistent domain config.
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9613067b-3440-4584-a2a2-38535e913dce from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:25 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:25 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 00:51:25 user nova-compute[73458]:   <target dev="sdc" bus="scsi"/>
Aug 27 00:51:25 user nova-compute[73458]:   <serial>d77b8e77-4840-4c27-8ca0-919cbd929159</serial>
Aug 27 00:51:25 user nova-compute[73458]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 00:51:25 user nova-compute[73458]: </disk>
Aug 27 00:51:25 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23334663062346534', 'path': '/dev/sdi'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334663062346534', 'path': '/dev/sdi'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.742s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:25 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:25 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3185d-ae5f-4e9e-9a78-7232a4bea86b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:25 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfgDjSvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:25 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18fbce-abf9-4921-93a2-f297f51d1286]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1] added
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d430233b-ceb8-4ad3-a471-8bc1fef5f19d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7296737-a29c-4d70-aa41-ca146379f395]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiwISVOq {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiwISVOq" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c03fb-ab01-4bd6-a912-787d50f66af3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiwISVOq'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e19e8-3dc2-483d-a245-ca2a6c6a8f5b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a31fd-a87f-4d8d-ac90-ec4e789a27d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.compute.manager [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Detaching volume fd593c83-448c-4c7e-8730-5cbad3ceef29
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.virt.block_device [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Attempting to driver detach volume fd593c83-448c-4c7e-8730-5cbad3ceef29 from mountpoint /dev/vdb
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Attempting to detach device vdb from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:25 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:25 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 00:51:25 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:25 user nova-compute[73458]:   <serial>fd593c83-448c-4c7e-8730-5cbad3ceef29</serial>
Aug 27 00:51:25 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 00:51:25 user nova-compute[73458]: </disk>
Aug 27 00:51:25 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e385976-4f90-4448-8d34-8eb1e91b5d32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260]
Aug 27 00:51:25 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully detached device vdb from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the persistent domain config.
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:25 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:25 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 00:51:25 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:25 user nova-compute[73458]:   <serial>fd593c83-448c-4c7e-8730-5cbad3ceef29</serial>
Aug 27 00:51:25 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 00:51:25 user nova-compute[73458]: </disk>
Aug 27 00:51:25 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667c0f1-6ca0-43c9-9b85-32b4b72561bb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2a032-ee77-406f-a6a1-653e835729b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e5cb4-57a3-4c13-a5ad-f8a201dfbad6]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiwISVOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097486.023581, 9613067b-3440-4584-a2a2-38535e913dce => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:51:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Successfully detached device sdc from instance 9613067b-3440-4584-a2a2-38535e913dce from the live domain config.
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeOwUdxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097486.3720691, 2f2d4e39-0c45-448e-add7-f053858edd8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:51:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully detached device vdb from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the live domain config.
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upzgTPGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance destroyed successfully.
Aug 27 00:51:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance destroyed successfully.
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1402922038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:51:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38e00a5-60, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:26 user nova-compute[73458]: INFO os_vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60')
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] <== connect_volume: return (2181ms) {'type': 'block', 'scsi_wwn': '23438663464663165', 'path': '/dev/sdj'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438663464663165', 'path': '/dev/sdj'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.404s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:26 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lazy-loading 'flavor' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38725c9c-8993-423d-b483-55280cd33a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:26 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33d542-cfab-488a-bc50-11d146852e2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005] added
Aug 27 00:51:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] attach device xml: <disk type="block" device="disk">
Aug 27 00:51:27 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:27 user nova-compute[73458]:   <source dev="/dev/sdj"/>
Aug 27 00:51:27 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:27 user nova-compute[73458]:   <serial>4533d4d6-a465-4748-9e74-6f73ecc08de1</serial>
Aug 27 00:51:27 user nova-compute[73458]: </disk>
Aug 27 00:51:27 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3037ef4-b4c9-4f9e-a13f-d7b9e31c7286]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0360a645-e105-411c-97fe-73c356218387]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfgDjSvO {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HfgDjSvO" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3528ffeb-bf5c-47f9-86d8-4e7334e6fe43]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HfgDjSvO'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1a114-e7d3-495f-91f8-e87a7d9ee288]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29f508b-eb6e-4c97-ae5b-0151f8705e78]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[22074c86-b277-4cc3-a6b2-ccf323b693c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260]
Aug 27 00:51:27 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af32a56-428c-44f4-baeb-419fa1f879c6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3247dfa2-8a4b-4509-be2d-6102d279b25c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:27 user nova-compute[73458]: WARNING nova.compute.manager [req-fb21c43a-3dad-469b-b013-8d424febd890 req-9f6fead6-9c5d-460d-9c6e-0881e2f78b45 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state rebuilding.
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc22b3-2ff8-4ce8-91d9-4df08d290aff]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfgDjSvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] No VIF found with MAC fa:16:3e:56:17:5b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb58fa2f-49eb-4790-a3e7-307e6ebb5c15 tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.586s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] volume_snapshot_create: create_info: {'snapshot_id': '11514b11-e458-4410-8f0a-3fcfbe0dfd1a', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73458) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] snap xml: <domainsnapshot>
Aug 27 00:51:28 user nova-compute[73458]:   <disks>
Aug 27 00:51:28 user nova-compute[73458]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 27 00:51:28 user nova-compute[73458]:       <source file="/dev/new_file"/>
Aug 27 00:51:28 user nova-compute[73458]:     </disk>
Aug 27 00:51:28 user nova-compute[73458]:     <disk name="vda" snapshot="no"/>
Aug 27 00:51:28 user nova-compute[73458]:   </disks>
Aug 27 00:51:28 user nova-compute[73458]: </domainsnapshot>
Aug 27 00:51:28 user nova-compute[73458]:  {{(pid=73458) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] Lazy-loading 'system_metadata' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== connect_volume: return (2799ms) {'type': 'block', 'scsi_wwn': '23438663435623939', 'path': '/dev/sdk'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438663435623939', 'path': '/dev/sdk'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.300s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     rv = execute(f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     six.reraise(c, e, tb)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     raise value
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     rv = meth(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     self._volume_snapshot_create(context, instance, guest,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     rv = execute(f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     six.reraise(c, e, tb)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     raise value
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     rv = meth(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] 
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db73c1d-d728-494e-a89d-e3229d227788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxCyzVju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:28 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9f26ea63-272c-4be2-bfca-e3280876902e tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] volume_snapshot_delete: delete_info: {'volume_id': '4533d4d6-a465-4748-9e74-6f73ecc08de1'} {{(pid=73458) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [None req-9f26ea63-272c-4be2-bfca-e3280876902e tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810]     if delete_info['type'] != 'qcow2':
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] KeyError: 'type'
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] 
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceef59b-c1a0-4f3e-9ed6-c07c99b0c555]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e901c7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159'): ({'sdg'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Removing single pathed devices sdg {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 11514b11-e458-4410-8f0a-3fcfbe0dfd1a could not be found.
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise value
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 11514b11-e458-4410-8f0a-3fcfbe0dfd1a could not be found. (HTTP 404) (Request-ID: req-452120f8-2a40-4e83-a1ff-1ea73a221b08)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 11514b11-e458-4410-8f0a-3fcfbe0dfd1a could not be found.
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver [None req-9f26ea63-272c-4be2-bfca-e3280876902e tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e408df18-3539-495a-b71a-72c4755f5c04)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 00:51:28 user nova-compute[73458]: ERROR nova.virt.libvirt.driver 
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server [None req-7b21b3c4-705a-4144-a5b1-f9658f4ce68a tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server 
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8339f-ad0c-464f-938d-08ba7b029fea]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server [None req-9f26ea63-272c-4be2-bfca-e3280876902e tempest-VolumesAssistedSnapshotsTest-1085661560 tempest-VolumesAssistedSnapshotsTest-1085661560-project] Exception during message handling: KeyError: 'type'
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 27 00:51:28 user nova-compute[73458]: ERROR oslo_messaging.rpc.server 
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aef4e5-afd2-40b5-b948-a089b3871b29]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Flushing IO for device /dev/sdg {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73326ed3-de62-4772-b7d0-85e5bf2cacda]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ac695-d2b2-4bff-86b1-391b8b8a7802]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30651f8-9be3-4cb4-bc85-98f0be767330]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[75102134-8010-4f0d-bc8f-18f5d576cab0]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260]
Aug 27 00:51:28 user nova-compute[73458]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:28 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:28 user nova-compute[73458]: INFO nova.compute.manager [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Detaching volume 4533d4d6-a465-4748-9e74-6f73ecc08de1
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d77b8e77-4840-4c27-8ca0-919cbd929159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[186434ca-d2ed-4e06-8de5-8470e279ae6f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] <== disconnect_volume: return (2690ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.351s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39112ebd-dc70-4d72-a7bc-922e7b817675]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: INFO nova.virt.block_device [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Attempting to driver detach volume 4533d4d6-a465-4748-9e74-6f73ecc08de1 from mountpoint /dev/vdb
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Attempting to detach device vdb from instance b7b683b7-a32c-42ee-9ee0-10bb03611810 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:28 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:28 user nova-compute[73458]:   <source dev="/dev/sdj"/>
Aug 27 00:51:28 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:28 user nova-compute[73458]:   <serial>4533d4d6-a465-4748-9e74-6f73ecc08de1</serial>
Aug 27 00:51:28 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:51:28 user nova-compute[73458]: </disk>
Aug 27 00:51:28 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24359015-8a69-4910-b8e7-838b64fc5750]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 (non-flash)
Aug 27 00:51:28 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e787288b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29'): ({'sdh'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Removing single pathed devices sdh {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Successfully detached device vdb from instance b7b683b7-a32c-42ee-9ee0-10bb03611810 from the persistent domain config.
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7b683b7-a32c-42ee-9ee0-10bb03611810 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 00:51:28 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:28 user nova-compute[73458]:   <source dev="/dev/sdj"/>
Aug 27 00:51:28 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:28 user nova-compute[73458]:   <serial>4533d4d6-a465-4748-9e74-6f73ecc08de1</serial>
Aug 27 00:51:28 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:51:28 user nova-compute[73458]: </disk>
Aug 27 00:51:28 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae96f1-06d6-4c02-b6e9-a8e215555bb0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9865daa-aea1-4b78-bab4-703b60338ed2]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Flushing IO for device /dev/sdh {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[567bcd0d-719e-4080-9815-521546f2c7a2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c87047-0f0c-452c-8463-e64dd9c2ac6a]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[687c64c2-5b4b-4e2c-bf5b-ff3e92b7cc24]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dfc2f5-d113-40e1-8140-1a5bdb5d0f21]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260]
Aug 27 00:51:29 user nova-compute[73458]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd593c83-448c-4c7e-8730-5cbad3ceef29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab4b21-2546-467c-b9ad-a0a783afdfee]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] <== disconnect_volume: return (2706ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.669s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b085959a-e53b-4d08-9aeb-e7c9269a55f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b765f-4eeb-44a8-aef4-317e7bb708ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78645990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfbabed-4116-440f-92f4-c14e00e81efd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31a40d-6b88-45fc-abe3-ad8b091de986]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c301c1-9a23-4949-ad56-055fa0ab8b0d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15be270-d7c2-48ac-a269-93e0bac12360]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097489.2694578, b7b683b7-a32c-42ee-9ee0-10bb03611810 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Successfully detached device vdb from instance b7b683b7-a32c-42ee-9ee0-10bb03611810 from the live domain config.
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiwISVOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:29 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d5a53-7fa6-4c79-8030-576b21bb784d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c3e9ac-64a0-4a7c-b4b7-0c376fa9a690]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]
Aug 27 00:51:29 user nova-compute[73458]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaaa094-0d93-4502-ac01-da698b8f96d9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== disconnect_volume: return (2984ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deleting instance files /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6_del
Aug 27 00:51:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deletion of /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6_del complete
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.843s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:29 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:29 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b3be9a-40bf-47c7-a017-16c25ae688f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:29 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7395c7-5cbf-41c7-8350-bbb6de1a1b75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4] added
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35454ac3-5551-4b72-a07e-0615f7d89fe1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d7dda5-4215-4fd9-8881-367547c1aa35]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQeBKSOL {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQeBKSOL" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712bdae-fe1d-4968-8819-dc5b4663fa25]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQeBKSOL'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[327b2baa-e126-4795-a9d6-0962c8898222]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56760f6-4948-46a8-a384-a3d2cc58aa37]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6 could not be found.
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:29 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG nova.objects.instance [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lazy-loading 'flavor' on Instance uuid 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-62fd13a2-c823-4576-bf0b-f0cf62984514 tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.433s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a0c80-660e-4fea-a0ca-7997fb1a52b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]
Aug 27 00:51:29 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[49befc72-c353-48bc-94c6-426f4d8dc4ba]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd90fd8-5829-4ddf-8388-56d5454e4ac5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c17418-b89a-4585-a304-a95d7d9a856a]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG nova.objects.instance [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3b326322-e4cc-4dc8-93ea-dfa21c714a59 tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.407s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] <== connect_volume: return (4234ms) {'type': 'block', 'scsi_wwn': '26232343633393164', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232343633393164', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.422s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:30 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:30 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG nova.objects.instance [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lazy-loading 'flavor' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b60e80-89c1-4a77-aa7f-306ce5c4b826]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:30 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:51:30 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:30 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:51:30 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:51:30 user nova-compute[73458]:   <serial>71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4</serial>
Aug 27 00:51:30 user nova-compute[73458]: </disk>
Aug 27 00:51:30 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ed0fe5-c653-4798-baa1-1555f32d4987]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60] added
Aug 27 00:51:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d3b70e-65aa-4511-a60a-3f5bf86c4b8b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1034161-82ad-460e-9542-352e5c2c3163]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxCyzVju {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxCyzVju" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc7e62-fac9-4811-b3de-963cc9793daf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxCyzVju'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8963b5-8e46-48be-a2b0-9f4c15c9d947]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d2584-7918-4fbc-be3c-7f906eaca643]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.compute.manager [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Terminating instance
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b9a42b-1d2f-4153-a3c5-52620984f1a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260]
Aug 27 00:51:31 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af559dc6-83a6-4a6c-a19b-b294f6833ff7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[be389bfc-ccfd-46cf-91ca-2182790f6526]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-297cf87f-2f0f-4e71-be86-bae4e65887eb" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-297cf87f-2f0f-4e71-be86-bae4e65887eb" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c5411b-e225-41a6-bb87-d0b550a59c3b]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxCyzVju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Attempting to detach device tap297cf87f-2f from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] detach device xml: <interface type="ethernet">
Aug 27 00:51:31 user nova-compute[73458]:   <mac address="fa:16:3e:c3:5c:71"/>
Aug 27 00:51:31 user nova-compute[73458]:   <model type="virtio"/>
Aug 27 00:51:31 user nova-compute[73458]:   <mtu size="1442"/>
Aug 27 00:51:31 user nova-compute[73458]:   <target dev="tap297cf87f-2f"/>
Aug 27 00:51:31 user nova-compute[73458]: </interface>
Aug 27 00:51:31 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] No VIF found with MAC fa:16:3e:79:9d:83, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 27 00:51:31 user nova-compute[73458]:   <name>instance-00000005</name>
Aug 27 00:51:31 user nova-compute[73458]:   <uuid>2f2d4e39-0c45-448e-add7-f053858edd8c</uuid>
Aug 27 00:51:31 user nova-compute[73458]:   <metadata>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:31 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:50:57</nova:creationTime>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:31 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:31 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:31 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:port uuid="297cf87f-2f0f-4e71-be86-bae4e65887eb">
Aug 27 00:51:31 user nova-compute[73458]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
Aug 27 00:51:31 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:31 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:31 user nova-compute[73458]:   </metadata>
Aug 27 00:51:31 user nova-compute[73458]:   <memory unit='KiB'>524288</memory>
Aug 27 00:51:31 user nova-compute[73458]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 00:51:31 user nova-compute[73458]:   <vcpu placement='static'>1</vcpu>
Aug 27 00:51:31 user nova-compute[73458]:   <resource>
Aug 27 00:51:31 user nova-compute[73458]:     <partition>/machine</partition>
Aug 27 00:51:31 user nova-compute[73458]:   </resource>
Aug 27 00:51:31 user nova-compute[73458]:   <sysinfo type='smbios'>
Aug 27 00:51:31 user nova-compute[73458]:     <system>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='version'>0.0.0</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='serial'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='uuid'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='family'>Virtual Machine</entry>
Aug 27 00:51:31 user nova-compute[73458]:     </system>
Aug 27 00:51:31 user nova-compute[73458]:   </sysinfo>
Aug 27 00:51:31 user nova-compute[73458]:   <os>
Aug 27 00:51:31 user nova-compute[73458]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 00:51:31 user nova-compute[73458]:     <boot dev='hd'/>
Aug 27 00:51:31 user nova-compute[73458]:     <smbios mode='sysinfo'/>
Aug 27 00:51:31 user nova-compute[73458]:   </os>
Aug 27 00:51:31 user nova-compute[73458]:   <features>
Aug 27 00:51:31 user nova-compute[73458]:     <acpi/>
Aug 27 00:51:31 user nova-compute[73458]:     <apic/>
Aug 27 00:51:31 user nova-compute[73458]:     <vmcoreinfo state='on'/>
Aug 27 00:51:31 user nova-compute[73458]:   </features>
Aug 27 00:51:31 user nova-compute[73458]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 00:51:31 user nova-compute[73458]:     <model fallback='forbid'>Nehalem</model>
Aug 27 00:51:31 user nova-compute[73458]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='vme'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='x2apic'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='hypervisor'/>
Aug 27 00:51:31 user nova-compute[73458]:   </cpu>
Aug 27 00:51:31 user nova-compute[73458]:   <clock offset='utc'>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='hpet' present='no'/>
Aug 27 00:51:31 user nova-compute[73458]:   </clock>
Aug 27 00:51:31 user nova-compute[73458]:   <on_poweroff>destroy</on_poweroff>
Aug 27 00:51:31 user nova-compute[73458]:   <on_reboot>restart</on_reboot>
Aug 27 00:51:31 user nova-compute[73458]:   <on_crash>destroy</on_crash>
Aug 27 00:51:31 user nova-compute[73458]:   <devices>
Aug 27 00:51:31 user nova-compute[73458]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 00:51:31 user nova-compute[73458]:     <disk type='file' device='disk'>
Aug 27 00:51:31 user nova-compute[73458]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 00:51:31 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk' index='2'/>
Aug 27 00:51:31 user nova-compute[73458]:       <backingStore type='file' index='3'>
Aug 27 00:51:31 user nova-compute[73458]:         <format type='raw'/>
Aug 27 00:51:31 user nova-compute[73458]:         <source file='/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0'/>
Aug 27 00:51:31 user nova-compute[73458]:         <backingStore/>
Aug 27 00:51:31 user nova-compute[73458]:       </backingStore>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='vda' bus='virtio'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='virtio-disk0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </disk>
Aug 27 00:51:31 user nova-compute[73458]:     <disk type='file' device='cdrom'>
Aug 27 00:51:31 user nova-compute[73458]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 00:51:31 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config' index='1'/>
Aug 27 00:51:31 user nova-compute[73458]:       <backingStore/>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='hda' bus='ide'/>
Aug 27 00:51:31 user nova-compute[73458]:       <readonly/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='ide0-0-0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </disk>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='usb' index='0' model='none'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='usb'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='pci.0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='ide' index='0'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='ide'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <interface type='ethernet'>
Aug 27 00:51:31 user nova-compute[73458]:       <mac address='fa:16:3e:4b:0e:c3'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='tap0c2bca75-97'/>
Aug 27 00:51:31 user nova-compute[73458]:       <model type='virtio'/>
Aug 27 00:51:31 user nova-compute[73458]:       <mtu size='1442'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='net0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </interface>
Aug 27 00:51:31 user nova-compute[73458]:     <interface type='ethernet'>
Aug 27 00:51:31 user nova-compute[73458]:       <mac address='fa:16:3e:c3:5c:71'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='tap297cf87f-2f'/>
Aug 27 00:51:31 user nova-compute[73458]:       <model type='virtio'/>
Aug 27 00:51:31 user nova-compute[73458]:       <mtu size='1442'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='net1'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </interface>
Aug 27 00:51:31 user nova-compute[73458]:     <serial type='pty'>
Aug 27 00:51:31 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:31 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target type='isa-serial' port='0'>
Aug 27 00:51:31 user nova-compute[73458]:         <model name='isa-serial'/>
Aug 27 00:51:31 user nova-compute[73458]:       </target>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </serial>
Aug 27 00:51:31 user nova-compute[73458]:     <console type='pty' tty='/dev/pts/4'>
Aug 27 00:51:31 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:31 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target type='serial' port='0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </console>
Aug 27 00:51:31 user nova-compute[73458]:     <input type='mouse' bus='ps2'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='input0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </input>
Aug 27 00:51:31 user nova-compute[73458]:     <input type='keyboard' bus='ps2'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='input1'/>
Aug 27 00:51:31 user nova-compute[73458]:     </input>
Aug 27 00:51:31 user nova-compute[73458]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 27 00:51:31 user nova-compute[73458]:       <listen type='address' address='0.0.0.0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </graphics>
Aug 27 00:51:31 user nova-compute[73458]:     <audio id='1' type='none'/>
Aug 27 00:51:31 user nova-compute[73458]:     <video>
Aug 27 00:51:31 user nova-compute[73458]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='video0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </video>
Aug 27 00:51:31 user nova-compute[73458]:     <memballoon model='virtio'>
Aug 27 00:51:31 user nova-compute[73458]:       <stats period='10'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='balloon0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </memballoon>
Aug 27 00:51:31 user nova-compute[73458]:     <rng model='virtio'>
Aug 27 00:51:31 user nova-compute[73458]:       <backend model='random'>/dev/urandom</backend>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='rng0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </rng>
Aug 27 00:51:31 user nova-compute[73458]:   </devices>
Aug 27 00:51:31 user nova-compute[73458]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 00:51:31 user nova-compute[73458]:     <label>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</label>
Aug 27 00:51:31 user nova-compute[73458]:     <imagelabel>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</imagelabel>
Aug 27 00:51:31 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:31 user nova-compute[73458]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 00:51:31 user nova-compute[73458]:     <label>+64055:+108</label>
Aug 27 00:51:31 user nova-compute[73458]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 00:51:31 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:31 user nova-compute[73458]: </domain>
Aug 27 00:51:31 user nova-compute[73458]:  {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully detached device tap297cf87f-2f from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the persistent domain config.
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] (1/8): Attempting to detach device tap297cf87f-2f with device alias net1 from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] detach device xml: <interface type="ethernet">
Aug 27 00:51:31 user nova-compute[73458]:   <mac address="fa:16:3e:c3:5c:71"/>
Aug 27 00:51:31 user nova-compute[73458]:   <model type="virtio"/>
Aug 27 00:51:31 user nova-compute[73458]:   <mtu size="1442"/>
Aug 27 00:51:31 user nova-compute[73458]:   <target dev="tap297cf87f-2f"/>
Aug 27 00:51:31 user nova-compute[73458]: </interface>
Aug 27 00:51:31 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-unplugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] No waiting events found dispatching network-vif-unplugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-629e3a55-15e5-4b8d-9774-7c97bc9d3fa0 req-13f9e2c9-5e04-4748-849f-818d25e08734 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-unplugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-22a2bf3d-455e-4c13-a1cd-af5a3e7fe88f tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.425s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097491.7125502, 2f2d4e39-0c45-448e-add7-f053858edd8c => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Start waiting for the detach event from libvirt for device tap297cf87f-2f with device alias net1 for instance 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 27 00:51:31 user nova-compute[73458]:   <name>instance-00000005</name>
Aug 27 00:51:31 user nova-compute[73458]:   <uuid>2f2d4e39-0c45-448e-add7-f053858edd8c</uuid>
Aug 27 00:51:31 user nova-compute[73458]:   <metadata>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:31 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:50:57</nova:creationTime>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:31 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:31 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:31 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:port uuid="297cf87f-2f0f-4e71-be86-bae4e65887eb">
Aug 27 00:51:31 user nova-compute[73458]:       <nova:ip type="fixed" address="10.10.10.99" ipVersion="4"/>
Aug 27 00:51:31 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:31 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:31 user nova-compute[73458]:   </metadata>
Aug 27 00:51:31 user nova-compute[73458]:   <memory unit='KiB'>524288</memory>
Aug 27 00:51:31 user nova-compute[73458]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 00:51:31 user nova-compute[73458]:   <vcpu placement='static'>1</vcpu>
Aug 27 00:51:31 user nova-compute[73458]:   <resource>
Aug 27 00:51:31 user nova-compute[73458]:     <partition>/machine</partition>
Aug 27 00:51:31 user nova-compute[73458]:   </resource>
Aug 27 00:51:31 user nova-compute[73458]:   <sysinfo type='smbios'>
Aug 27 00:51:31 user nova-compute[73458]:     <system>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='version'>0.0.0</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='serial'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='uuid'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:31 user nova-compute[73458]:       <entry name='family'>Virtual Machine</entry>
Aug 27 00:51:31 user nova-compute[73458]:     </system>
Aug 27 00:51:31 user nova-compute[73458]:   </sysinfo>
Aug 27 00:51:31 user nova-compute[73458]:   <os>
Aug 27 00:51:31 user nova-compute[73458]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 00:51:31 user nova-compute[73458]:     <boot dev='hd'/>
Aug 27 00:51:31 user nova-compute[73458]:     <smbios mode='sysinfo'/>
Aug 27 00:51:31 user nova-compute[73458]:   </os>
Aug 27 00:51:31 user nova-compute[73458]:   <features>
Aug 27 00:51:31 user nova-compute[73458]:     <acpi/>
Aug 27 00:51:31 user nova-compute[73458]:     <apic/>
Aug 27 00:51:31 user nova-compute[73458]:     <vmcoreinfo state='on'/>
Aug 27 00:51:31 user nova-compute[73458]:   </features>
Aug 27 00:51:31 user nova-compute[73458]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 00:51:31 user nova-compute[73458]:     <model fallback='forbid'>Nehalem</model>
Aug 27 00:51:31 user nova-compute[73458]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='vme'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='x2apic'/>
Aug 27 00:51:31 user nova-compute[73458]:     <feature policy='require' name='hypervisor'/>
Aug 27 00:51:31 user nova-compute[73458]:   </cpu>
Aug 27 00:51:31 user nova-compute[73458]:   <clock offset='utc'>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 00:51:31 user nova-compute[73458]:     <timer name='hpet' present='no'/>
Aug 27 00:51:31 user nova-compute[73458]:   </clock>
Aug 27 00:51:31 user nova-compute[73458]:   <on_poweroff>destroy</on_poweroff>
Aug 27 00:51:31 user nova-compute[73458]:   <on_reboot>restart</on_reboot>
Aug 27 00:51:31 user nova-compute[73458]:   <on_crash>destroy</on_crash>
Aug 27 00:51:31 user nova-compute[73458]:   <devices>
Aug 27 00:51:31 user nova-compute[73458]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 00:51:31 user nova-compute[73458]:     <disk type='file' device='disk'>
Aug 27 00:51:31 user nova-compute[73458]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 00:51:31 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk' index='2'/>
Aug 27 00:51:31 user nova-compute[73458]:       <backingStore type='file' index='3'>
Aug 27 00:51:31 user nova-compute[73458]:         <format type='raw'/>
Aug 27 00:51:31 user nova-compute[73458]:         <source file='/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0'/>
Aug 27 00:51:31 user nova-compute[73458]:         <backingStore/>
Aug 27 00:51:31 user nova-compute[73458]:       </backingStore>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='vda' bus='virtio'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='virtio-disk0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </disk>
Aug 27 00:51:31 user nova-compute[73458]:     <disk type='file' device='cdrom'>
Aug 27 00:51:31 user nova-compute[73458]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 00:51:31 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config' index='1'/>
Aug 27 00:51:31 user nova-compute[73458]:       <backingStore/>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='hda' bus='ide'/>
Aug 27 00:51:31 user nova-compute[73458]:       <readonly/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='ide0-0-0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </disk>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='usb' index='0' model='none'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='usb'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='pci.0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <controller type='ide' index='0'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='ide'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 00:51:31 user nova-compute[73458]:     </controller>
Aug 27 00:51:31 user nova-compute[73458]:     <interface type='ethernet'>
Aug 27 00:51:31 user nova-compute[73458]:       <mac address='fa:16:3e:4b:0e:c3'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target dev='tap0c2bca75-97'/>
Aug 27 00:51:31 user nova-compute[73458]:       <model type='virtio'/>
Aug 27 00:51:31 user nova-compute[73458]:       <mtu size='1442'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='net0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </interface>
Aug 27 00:51:31 user nova-compute[73458]:     <serial type='pty'>
Aug 27 00:51:31 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:31 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target type='isa-serial' port='0'>
Aug 27 00:51:31 user nova-compute[73458]:         <model name='isa-serial'/>
Aug 27 00:51:31 user nova-compute[73458]:       </target>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </serial>
Aug 27 00:51:31 user nova-compute[73458]:     <console type='pty' tty='/dev/pts/4'>
Aug 27 00:51:31 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:31 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:31 user nova-compute[73458]:       <target type='serial' port='0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </console>
Aug 27 00:51:31 user nova-compute[73458]:     <input type='mouse' bus='ps2'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='input0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </input>
Aug 27 00:51:31 user nova-compute[73458]:     <input type='keyboard' bus='ps2'>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='input1'/>
Aug 27 00:51:31 user nova-compute[73458]:     </input>
Aug 27 00:51:31 user nova-compute[73458]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 27 00:51:31 user nova-compute[73458]:       <listen type='address' address='0.0.0.0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </graphics>
Aug 27 00:51:31 user nova-compute[73458]:     <audio id='1' type='none'/>
Aug 27 00:51:31 user nova-compute[73458]:     <video>
Aug 27 00:51:31 user nova-compute[73458]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='video0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </video>
Aug 27 00:51:31 user nova-compute[73458]:     <memballoon model='virtio'>
Aug 27 00:51:31 user nova-compute[73458]:       <stats period='10'/>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='balloon0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </memballoon>
Aug 27 00:51:31 user nova-compute[73458]:     <rng model='virtio'>
Aug 27 00:51:31 user nova-compute[73458]:       <backend model='random'>/dev/urandom</backend>
Aug 27 00:51:31 user nova-compute[73458]:       <alias name='rng0'/>
Aug 27 00:51:31 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 00:51:31 user nova-compute[73458]:     </rng>
Aug 27 00:51:31 user nova-compute[73458]:   </devices>
Aug 27 00:51:31 user nova-compute[73458]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 00:51:31 user nova-compute[73458]:     <label>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</label>
Aug 27 00:51:31 user nova-compute[73458]:     <imagelabel>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</imagelabel>
Aug 27 00:51:31 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:31 user nova-compute[73458]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 00:51:31 user nova-compute[73458]:     <label>+64055:+108</label>
Aug 27 00:51:31 user nova-compute[73458]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 00:51:31 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:31 user nova-compute[73458]: </domain>
Aug 27 00:51:31 user nova-compute[73458]:  {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully detached device tap297cf87f-2f from instance 2f2d4e39-0c45-448e-add7-f053858edd8c from the live domain config.
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_vif [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap297cf87f-2f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: INFO os_vif [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f')
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:31 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:51:31</nova:creationTime>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:31 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:31 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:31 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:31 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:31 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:31 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:31 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:31 user nova-compute[73458]:  {{(pid=73458) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Instance destroyed successfully.
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lazy-loading 'resources' on Instance uuid 9613067b-3440-4584-a2a2-38535e913dce {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-83362416',display_name='tempest-AttachSCSIVolumeTestJSON-server-83362416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-83362416',id=4,image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+AgaLFIOBs6w3umYI3lAeQTid3QVJxuE6sYzik67uGdEOnIdKed6rUWH/hIZxOBPwlRxJVt1dH9hdw5ceq/4xoVBagce0E2F9/u8gKXXypj8h5n3jjkOWGoqyMXr26HA==',key_name='tempest-keypair-1324839820',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f6c0009acfe4ab6868908ca1d05c978',ramdisk_id='',reservation_id='r-eg12f1f1',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='43a81ed6-1b9d-4b52-a36e-72e421b38442',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1958255642',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1958255642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1cd86ab850fa4504992ce17b059c6913',uuid=9613067b-3440-4584-a2a2-38535e913dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converting VIF {"id": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "address": "fa:16:3e:3c:80:d2", "network": {"id": "928739a7-a1b4-49ba-9882-5ea9eb2942dc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1713394267-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f6c0009acfe4ab6868908ca1d05c978", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3685bf83-03", "ovs_interfaceid": "3685bf83-03cd-4f89-bffc-e6c1f74dde2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG os_vif [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3685bf83-03, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-unplugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-unplugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:31 user nova-compute[73458]: WARNING nova.compute.manager [req-f7daf014-992c-4d95-9043-831551748d2d req-a836c33d-063b-41fc-893c-c1d374437496 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-unplugged-297cf87f-2f0f-4e71-be86-bae4e65887eb for instance with vm_state active and task_state None.
Aug 27 00:51:31 user nova-compute[73458]: INFO os_vif [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:80:d2,bridge_name='br-int',has_traffic_filtering=True,id=3685bf83-03cd-4f89-bffc-e6c1f74dde2f,network=Network(928739a7-a1b4-49ba-9882-5ea9eb2942dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3685bf83-03')
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Deleting instance files /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce_del
Aug 27 00:51:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Deletion of /opt/stack/data/nova/instances/9613067b-3440-4584-a2a2-38535e913dce_del complete
Aug 27 00:51:32 user nova-compute[73458]: INFO nova.compute.manager [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== connect_volume: return (3841ms) {'type': 'block', 'scsi_wwn': '26538386563613565', 'path': '/dev/sdg'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538386563613565', 'path': '/dev/sdg'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.957s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553da36-58b7-4b87-b9a3-54f3d11f417d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.objects.instance [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cc46c0f-ed32-4ad4-acea-c91399a3d883 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093d5de-4c4b-40a8-ba14-7853e5ea5835]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:51:32 user nova-compute[73458]:   <uuid>3cc46c0f-ed32-4ad4-acea-c91399a3d883</uuid>
Aug 27 00:51:32 user nova-compute[73458]:   <name>instance-0000000b</name>
Aug 27 00:51:32 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:51:32 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:51:32 user nova-compute[73458]:   <metadata>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:32 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:name>tempest-device-tagging-server-433067106</nova:name>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:51:24</nova:creationTime>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:51:32 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:32 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:user uuid="fc13d243d19e49c58823b958b76c20eb">tempest-TaggedBootDevicesTest-475681524-project-member</nova:user>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:project uuid="7ca8d63bdcdc4f14a74b584b42540437">tempest-TaggedBootDevicesTest-475681524</nova:project>
Aug 27 00:51:32 user nova-compute[73458]:       </nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:32 user nova-compute[73458]:       <nova:ports>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="f1d2df5a-cf3a-496f-98fc-1c97aa9684d5">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="fa924b9f-07af-41ed-ac93-d00ae2072e37">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="6f6f8399-2933-4ee4-86ba-8399e29648fb">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="cde54ab3-f79c-47ee-9ae6-a1170bd09a86">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="3a5fa9f3-affe-4868-af41-e0c1e30a2fcb">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="0d4efb28-7efd-4ad3-a40f-328c99958fc2">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:         <nova:port uuid="163386e1-69f4-4959-8de8-ccfa7372d4c6">
Aug 27 00:51:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:         </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:       </nova:ports>
Aug 27 00:51:32 user nova-compute[73458]:     </nova:instance>
Aug 27 00:51:32 user nova-compute[73458]:   </metadata>
Aug 27 00:51:32 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:51:32 user nova-compute[73458]:     <system>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="serial">3cc46c0f-ed32-4ad4-acea-c91399a3d883</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="uuid">3cc46c0f-ed32-4ad4-acea-c91399a3d883</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:51:32 user nova-compute[73458]:     </system>
Aug 27 00:51:32 user nova-compute[73458]:   </sysinfo>
Aug 27 00:51:32 user nova-compute[73458]:   <os>
Aug 27 00:51:32 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:51:32 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:51:32 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:51:32 user nova-compute[73458]:   </os>
Aug 27 00:51:32 user nova-compute[73458]:   <features>
Aug 27 00:51:32 user nova-compute[73458]:     <acpi/>
Aug 27 00:51:32 user nova-compute[73458]:     <apic/>
Aug 27 00:51:32 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:51:32 user nova-compute[73458]:   </features>
Aug 27 00:51:32 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:51:32 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:51:32 user nova-compute[73458]:   </clock>
Aug 27 00:51:32 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:51:32 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:51:32 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:51:32 user nova-compute[73458]:   </cpu>
Aug 27 00:51:32 user nova-compute[73458]:   <devices>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type="file" device="cdrom">
Aug 27 00:51:32 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 00:51:32 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/disk.config"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="hda" bus="ide"/>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:51:32 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:32 user nova-compute[73458]:       <source dev="/dev/sdi"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <serial>0a85f40b-c0ce-435e-adbd-64be614ba522</serial>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:51:32 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:32 user nova-compute[73458]:       <source dev="/dev/sdk"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <serial>da34ba64-594b-47c8-8586-89c26a364005</serial>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:51:32 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:51:32 user nova-compute[73458]:       <source dev="/dev/sdg"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="vdc" bus="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <serial>96c1d4e1-22ed-4297-a662-35307fdedb60</serial>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:e2:e4:15"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tapf1d2df5a-cf"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:77:0b:15"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tapfa924b9f-07"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:20:b6:32"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tap6f6f8399-29"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:ca:5f:56"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tapcde54ab3-f7"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:53:b2:1a"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tap3a5fa9f3-af"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:8b:43:a6"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tap0d4efb28-7e"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:51:32 user nova-compute[73458]:       <mac address="fa:16:3e:22:d9:99"/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev="tap163386e1-69"/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:51:32 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/console.log" append="off"/>
Aug 27 00:51:32 user nova-compute[73458]:     </serial>
Aug 27 00:51:32 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:51:32 user nova-compute[73458]:     <video>
Aug 27 00:51:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:51:32 user nova-compute[73458]:     </video>
Aug 27 00:51:32 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:51:32 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:51:32 user nova-compute[73458]:     </rng>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:51:32 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:51:32 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:51:32 user nova-compute[73458]:     </memballoon>
Aug 27 00:51:32 user nova-compute[73458]:   </devices>
Aug 27 00:51:32 user nova-compute[73458]: </domain>
Aug 27 00:51:32 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e981e1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1'): ({'sdj'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Removing single pathed devices sdj {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1d2df5a-cf, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1d2df5a-cf, col_values=(('external_ids', {'iface-id': 'f1d2df5a-cf3a-496f-98fc-1c97aa9684d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:e4:15', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-deleted-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:32 user nova-compute[73458]: INFO nova.compute.manager [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Neutron deleted interface 297cf87f-2f0f-4e71-be86-bae4e65887eb; detaching it from the instance and deleting it from the info cache
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquired lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c97a618-5b55-45ec-aed3-d4d87afc7751]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa924b9f-07, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfa924b9f-07, col_values=(('external_ids', {'iface-id': 'fa924b9f-07af-41ed-ac93-d00ae2072e37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:0b:15', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.objects.instance [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Lazy-loading 'system_metadata' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e40a92-d54a-4389-83eb-42a0d1860051]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Flushing IO for device /dev/sdj {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f6f8399-29, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f6f8399-29, col_values=(('external_ids', {'iface-id': '6f6f8399-2933-4ee4-86ba-8399e29648fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:b6:32', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db75def6-23b7-4e47-9819-d6fdc5e42088]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.objects.instance [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Lazy-loading 'flavor' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcde54ab3-f7, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcde54ab3-f7, col_values=(('external_ids', {'iface-id': 'cde54ab3-f79c-47ee-9ae6-a1170bd09a86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:5f:56', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.objects.base [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Object Instance<2f2d4e39-0c45-448e-add7-f053858edd8c> lazy-loaded attributes: system_metadata,flavor {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.080s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b28306-d0ca-40ec-a14c-231a0800ebaa]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] SCSI volumes sdj have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 27 00:51:32 user nova-compute[73458]:   <name>instance-00000005</name>
Aug 27 00:51:32 user nova-compute[73458]:   <uuid>2f2d4e39-0c45-448e-add7-f053858edd8c</uuid>
Aug 27 00:51:32 user nova-compute[73458]:   <metadata>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:32 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:51:31</nova:creationTime>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:32 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:32 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:32 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:32 user nova-compute[73458]:   </metadata>
Aug 27 00:51:32 user nova-compute[73458]:   <memory unit='KiB'>524288</memory>
Aug 27 00:51:32 user nova-compute[73458]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 00:51:32 user nova-compute[73458]:   <vcpu placement='static'>1</vcpu>
Aug 27 00:51:32 user nova-compute[73458]:   <resource>
Aug 27 00:51:32 user nova-compute[73458]:     <partition>/machine</partition>
Aug 27 00:51:32 user nova-compute[73458]:   </resource>
Aug 27 00:51:32 user nova-compute[73458]:   <sysinfo type='smbios'>
Aug 27 00:51:32 user nova-compute[73458]:     <system>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='version'>0.0.0</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='serial'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='uuid'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='family'>Virtual Machine</entry>
Aug 27 00:51:32 user nova-compute[73458]:     </system>
Aug 27 00:51:32 user nova-compute[73458]:   </sysinfo>
Aug 27 00:51:32 user nova-compute[73458]:   <os>
Aug 27 00:51:32 user nova-compute[73458]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 00:51:32 user nova-compute[73458]:     <boot dev='hd'/>
Aug 27 00:51:32 user nova-compute[73458]:     <smbios mode='sysinfo'/>
Aug 27 00:51:32 user nova-compute[73458]:   </os>
Aug 27 00:51:32 user nova-compute[73458]:   <features>
Aug 27 00:51:32 user nova-compute[73458]:     <acpi/>
Aug 27 00:51:32 user nova-compute[73458]:     <apic/>
Aug 27 00:51:32 user nova-compute[73458]:     <vmcoreinfo state='on'/>
Aug 27 00:51:32 user nova-compute[73458]:   </features>
Aug 27 00:51:32 user nova-compute[73458]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 00:51:32 user nova-compute[73458]:     <model fallback='forbid'>Nehalem</model>
Aug 27 00:51:32 user nova-compute[73458]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='vme'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='x2apic'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='hypervisor'/>
Aug 27 00:51:32 user nova-compute[73458]:   </cpu>
Aug 27 00:51:32 user nova-compute[73458]:   <clock offset='utc'>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='hpet' present='no'/>
Aug 27 00:51:32 user nova-compute[73458]:   </clock>
Aug 27 00:51:32 user nova-compute[73458]:   <on_poweroff>destroy</on_poweroff>
Aug 27 00:51:32 user nova-compute[73458]:   <on_reboot>restart</on_reboot>
Aug 27 00:51:32 user nova-compute[73458]:   <on_crash>destroy</on_crash>
Aug 27 00:51:32 user nova-compute[73458]:   <devices>
Aug 27 00:51:32 user nova-compute[73458]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type='file' device='disk'>
Aug 27 00:51:32 user nova-compute[73458]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 00:51:32 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk' index='2'/>
Aug 27 00:51:32 user nova-compute[73458]:       <backingStore type='file' index='3'>
Aug 27 00:51:32 user nova-compute[73458]:         <format type='raw'/>
Aug 27 00:51:32 user nova-compute[73458]:         <source file='/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0'/>
Aug 27 00:51:32 user nova-compute[73458]:         <backingStore/>
Aug 27 00:51:32 user nova-compute[73458]:       </backingStore>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='vda' bus='virtio'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='virtio-disk0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type='file' device='cdrom'>
Aug 27 00:51:32 user nova-compute[73458]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 00:51:32 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config' index='1'/>
Aug 27 00:51:32 user nova-compute[73458]:       <backingStore/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='hda' bus='ide'/>
Aug 27 00:51:32 user nova-compute[73458]:       <readonly/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='ide0-0-0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='usb' index='0' model='none'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='usb'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='pci.0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='ide' index='0'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='ide'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type='ethernet'>
Aug 27 00:51:32 user nova-compute[73458]:       <mac address='fa:16:3e:4b:0e:c3'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='tap0c2bca75-97'/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type='virtio'/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size='1442'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='net0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <serial type='pty'>
Aug 27 00:51:32 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:32 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target type='isa-serial' port='0'>
Aug 27 00:51:32 user nova-compute[73458]:         <model name='isa-serial'/>
Aug 27 00:51:32 user nova-compute[73458]:       </target>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </serial>
Aug 27 00:51:32 user nova-compute[73458]:     <console type='pty' tty='/dev/pts/4'>
Aug 27 00:51:32 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:32 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target type='serial' port='0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </console>
Aug 27 00:51:32 user nova-compute[73458]:     <input type='mouse' bus='ps2'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='input0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </input>
Aug 27 00:51:32 user nova-compute[73458]:     <input type='keyboard' bus='ps2'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='input1'/>
Aug 27 00:51:32 user nova-compute[73458]:     </input>
Aug 27 00:51:32 user nova-compute[73458]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 27 00:51:32 user nova-compute[73458]:       <listen type='address' address='0.0.0.0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </graphics>
Aug 27 00:51:32 user nova-compute[73458]:     <audio id='1' type='none'/>
Aug 27 00:51:32 user nova-compute[73458]:     <video>
Aug 27 00:51:32 user nova-compute[73458]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='video0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </video>
Aug 27 00:51:32 user nova-compute[73458]:     <memballoon model='virtio'>
Aug 27 00:51:32 user nova-compute[73458]:       <stats period='10'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='balloon0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </memballoon>
Aug 27 00:51:32 user nova-compute[73458]:     <rng model='virtio'>
Aug 27 00:51:32 user nova-compute[73458]:       <backend model='random'>/dev/urandom</backend>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='rng0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </rng>
Aug 27 00:51:32 user nova-compute[73458]:   </devices>
Aug 27 00:51:32 user nova-compute[73458]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 00:51:32 user nova-compute[73458]:     <label>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</label>
Aug 27 00:51:32 user nova-compute[73458]:     <imagelabel>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</imagelabel>
Aug 27 00:51:32 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:32 user nova-compute[73458]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 00:51:32 user nova-compute[73458]:     <label>+64055:+108</label>
Aug 27 00:51:32 user nova-compute[73458]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 00:51:32 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:32 user nova-compute[73458]: </domain>
Aug 27 00:51:32 user nova-compute[73458]:  {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface> {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c3:5c:71"/><model type="virtio"/><mtu size="1442"/><target dev="tap297cf87f-2f"/></interface>not found in domain: <domain type='kvm' id='5'>
Aug 27 00:51:32 user nova-compute[73458]:   <name>instance-00000005</name>
Aug 27 00:51:32 user nova-compute[73458]:   <uuid>2f2d4e39-0c45-448e-add7-f053858edd8c</uuid>
Aug 27 00:51:32 user nova-compute[73458]:   <metadata>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:32 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:51:31</nova:creationTime>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:32 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:32 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:32 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:32 user nova-compute[73458]:   </metadata>
Aug 27 00:51:32 user nova-compute[73458]:   <memory unit='KiB'>524288</memory>
Aug 27 00:51:32 user nova-compute[73458]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 00:51:32 user nova-compute[73458]:   <vcpu placement='static'>1</vcpu>
Aug 27 00:51:32 user nova-compute[73458]:   <resource>
Aug 27 00:51:32 user nova-compute[73458]:     <partition>/machine</partition>
Aug 27 00:51:32 user nova-compute[73458]:   </resource>
Aug 27 00:51:32 user nova-compute[73458]:   <sysinfo type='smbios'>
Aug 27 00:51:32 user nova-compute[73458]:     <system>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='version'>0.0.0</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='serial'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='uuid'>2f2d4e39-0c45-448e-add7-f053858edd8c</entry>
Aug 27 00:51:32 user nova-compute[73458]:       <entry name='family'>Virtual Machine</entry>
Aug 27 00:51:32 user nova-compute[73458]:     </system>
Aug 27 00:51:32 user nova-compute[73458]:   </sysinfo>
Aug 27 00:51:32 user nova-compute[73458]:   <os>
Aug 27 00:51:32 user nova-compute[73458]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 00:51:32 user nova-compute[73458]:     <boot dev='hd'/>
Aug 27 00:51:32 user nova-compute[73458]:     <smbios mode='sysinfo'/>
Aug 27 00:51:32 user nova-compute[73458]:   </os>
Aug 27 00:51:32 user nova-compute[73458]:   <features>
Aug 27 00:51:32 user nova-compute[73458]:     <acpi/>
Aug 27 00:51:32 user nova-compute[73458]:     <apic/>
Aug 27 00:51:32 user nova-compute[73458]:     <vmcoreinfo state='on'/>
Aug 27 00:51:32 user nova-compute[73458]:   </features>
Aug 27 00:51:32 user nova-compute[73458]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 00:51:32 user nova-compute[73458]:     <model fallback='forbid'>Nehalem</model>
Aug 27 00:51:32 user nova-compute[73458]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='vme'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='x2apic'/>
Aug 27 00:51:32 user nova-compute[73458]:     <feature policy='require' name='hypervisor'/>
Aug 27 00:51:32 user nova-compute[73458]:   </cpu>
Aug 27 00:51:32 user nova-compute[73458]:   <clock offset='utc'>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 00:51:32 user nova-compute[73458]:     <timer name='hpet' present='no'/>
Aug 27 00:51:32 user nova-compute[73458]:   </clock>
Aug 27 00:51:32 user nova-compute[73458]:   <on_poweroff>destroy</on_poweroff>
Aug 27 00:51:32 user nova-compute[73458]:   <on_reboot>restart</on_reboot>
Aug 27 00:51:32 user nova-compute[73458]:   <on_crash>destroy</on_crash>
Aug 27 00:51:32 user nova-compute[73458]:   <devices>
Aug 27 00:51:32 user nova-compute[73458]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type='file' device='disk'>
Aug 27 00:51:32 user nova-compute[73458]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 00:51:32 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk' index='2'/>
Aug 27 00:51:32 user nova-compute[73458]:       <backingStore type='file' index='3'>
Aug 27 00:51:32 user nova-compute[73458]:         <format type='raw'/>
Aug 27 00:51:32 user nova-compute[73458]:         <source file='/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0'/>
Aug 27 00:51:32 user nova-compute[73458]:         <backingStore/>
Aug 27 00:51:32 user nova-compute[73458]:       </backingStore>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='vda' bus='virtio'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='virtio-disk0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <disk type='file' device='cdrom'>
Aug 27 00:51:32 user nova-compute[73458]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 00:51:32 user nova-compute[73458]:       <source file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk.config' index='1'/>
Aug 27 00:51:32 user nova-compute[73458]:       <backingStore/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='hda' bus='ide'/>
Aug 27 00:51:32 user nova-compute[73458]:       <readonly/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='ide0-0-0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </disk>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='usb' index='0' model='none'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='usb'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='pci.0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <controller type='ide' index='0'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='ide'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 00:51:32 user nova-compute[73458]:     </controller>
Aug 27 00:51:32 user nova-compute[73458]:     <interface type='ethernet'>
Aug 27 00:51:32 user nova-compute[73458]:       <mac address='fa:16:3e:4b:0e:c3'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target dev='tap0c2bca75-97'/>
Aug 27 00:51:32 user nova-compute[73458]:       <model type='virtio'/>
Aug 27 00:51:32 user nova-compute[73458]:       <mtu size='1442'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='net0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </interface>
Aug 27 00:51:32 user nova-compute[73458]:     <serial type='pty'>
Aug 27 00:51:32 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:32 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target type='isa-serial' port='0'>
Aug 27 00:51:32 user nova-compute[73458]:         <model name='isa-serial'/>
Aug 27 00:51:32 user nova-compute[73458]:       </target>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </serial>
Aug 27 00:51:32 user nova-compute[73458]:     <console type='pty' tty='/dev/pts/4'>
Aug 27 00:51:32 user nova-compute[73458]:       <source path='/dev/pts/4'/>
Aug 27 00:51:32 user nova-compute[73458]:       <log file='/opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/console.log' append='off'/>
Aug 27 00:51:32 user nova-compute[73458]:       <target type='serial' port='0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='serial0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </console>
Aug 27 00:51:32 user nova-compute[73458]:     <input type='mouse' bus='ps2'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='input0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </input>
Aug 27 00:51:32 user nova-compute[73458]:     <input type='keyboard' bus='ps2'>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='input1'/>
Aug 27 00:51:32 user nova-compute[73458]:     </input>
Aug 27 00:51:32 user nova-compute[73458]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Aug 27 00:51:32 user nova-compute[73458]:       <listen type='address' address='0.0.0.0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </graphics>
Aug 27 00:51:32 user nova-compute[73458]:     <audio id='1' type='none'/>
Aug 27 00:51:32 user nova-compute[73458]:     <video>
Aug 27 00:51:32 user nova-compute[73458]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='video0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </video>
Aug 27 00:51:32 user nova-compute[73458]:     <memballoon model='virtio'>
Aug 27 00:51:32 user nova-compute[73458]:       <stats period='10'/>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='balloon0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </memballoon>
Aug 27 00:51:32 user nova-compute[73458]:     <rng model='virtio'>
Aug 27 00:51:32 user nova-compute[73458]:       <backend model='random'>/dev/urandom</backend>
Aug 27 00:51:32 user nova-compute[73458]:       <alias name='rng0'/>
Aug 27 00:51:32 user nova-compute[73458]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 00:51:32 user nova-compute[73458]:     </rng>
Aug 27 00:51:32 user nova-compute[73458]:   </devices>
Aug 27 00:51:32 user nova-compute[73458]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 00:51:32 user nova-compute[73458]:     <label>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</label>
Aug 27 00:51:32 user nova-compute[73458]:     <imagelabel>libvirt-2f2d4e39-0c45-448e-add7-f053858edd8c</imagelabel>
Aug 27 00:51:32 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:32 user nova-compute[73458]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 00:51:32 user nova-compute[73458]:     <label>+64055:+108</label>
Aug 27 00:51:32 user nova-compute[73458]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 00:51:32 user nova-compute[73458]:   </seclabel>
Aug 27 00:51:32 user nova-compute[73458]: </domain>
Aug 27 00:51:32 user nova-compute[73458]:  {{(pid=73458) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 00:51:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Detaching interface fa:16:3e:c3:5c:71 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap297cf87f-2f' not found.
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Converting VIF {"id": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "address": "fa:16:3e:c3:5c:71", "network": {"id": "a50d4dcf-143f-449d-9831-9a095b478da8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-4205040", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297cf87f-2f", "ovs_interfaceid": "297cf87f-2f0f-4e71-be86-bae4e65887eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap297cf87f-2f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5c:71,bridge_name='br-int',has_traffic_filtering=True,id=297cf87f-2f0f-4e71-be86-bae4e65887eb,network=Network(a50d4dcf-143f-449d-9831-9a095b478da8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297cf87f-2f')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [req-cb34d5b1-27e9-4b04-abc4-9d2c5e7175d9 req-2d43e908-103a-46e9-831d-d24e6afc8f55 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:51:32 user nova-compute[73458]:   <nova:package version="0.0.0"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:name>tempest-device-tagging-server-1711372017</nova:name>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:creationTime>2023-08-27 00:51:32</nova:creationTime>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:flavor name="m1.tiny">
Aug 27 00:51:32 user nova-compute[73458]:     <nova:memory>512</nova:memory>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:disk>1</nova:disk>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:swap>0</nova:swap>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:vcpus>1</nova:vcpus>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:flavor>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:user uuid="a77564556f9e41ff9bbe4e77d9c08c4d">tempest-TaggedAttachmentsTest-873623990-project-member</nova:user>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:project uuid="f191e470513741d7b951be664ca14122">tempest-TaggedAttachmentsTest-873623990</nova:project>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:owner>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:51:32 user nova-compute[73458]:   <nova:ports>
Aug 27 00:51:32 user nova-compute[73458]:     <nova:port uuid="0c2bca75-976d-49fe-a789-30aacb954db8">
Aug 27 00:51:32 user nova-compute[73458]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:51:32 user nova-compute[73458]:     </nova:port>
Aug 27 00:51:32 user nova-compute[73458]:   </nova:ports>
Aug 27 00:51:32 user nova-compute[73458]: </nova:instance>
Aug 27 00:51:32 user nova-compute[73458]:  {{(pid=73458) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a5fa9f3-af, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a5fa9f3-af, col_values=(('external_ids', {'iface-id': '3a5fa9f3-affe-4868-af41-e0c1e30a2fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b2:1a', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33eb8b-94d7-4748-a785-63764258ab36]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d4efb28-7e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d4efb28-7e, col_values=(('external_ids', {'iface-id': '0d4efb28-7efd-4ad3-a40f-328c99958fc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:43:a6', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a92121-f55c-46b9-9b3a-2f38c0b889fa]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260]
Aug 27 00:51:32 user nova-compute[73458]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4533d4d6-a465-4748-9e74-6f73ecc08de1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f1fa0d-7128-423e-9d2e-fd7f47aeafe6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] <== disconnect_volume: return (3379ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.030s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:50:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap163386e1-69, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap163386e1-69, col_values=(('external_ids', {'iface-id': '163386e1-69f4-4959-8de8-ccfa7372d4c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d9:99', 'vm-uuid': '3cc46c0f-ed32-4ad4-acea-c91399a3d883'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe262c6-2df0-4c45-8932-f554f8cc0518]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2e143-eee1-4428-9660-dc79c5cf5f43]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eae2a70>, {}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Disconnecting from: [] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== disconnect_volume: return (3108ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:32 user nova-compute[73458]: INFO os_vif [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69')
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] No BDM found with device name hda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] No VIF found with MAC fa:16:3e:e2:e4:15, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] No VIF found with MAC fa:16:3e:53:b2:1a, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:51:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Using config drive
Aug 27 00:51:32 user nova-compute[73458]: INFO nova.network.neutron [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Port 297cf87f-2f0f-4e71-be86-bae4e65887eb from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 27 00:51:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [{"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Releasing lock "refresh_cache-2f2d4e39-0c45-448e-add7-f053858edd8c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG os_brick.utils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc131a-9e5d-46ad-a136-ae185691cdf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1d333a6a-922e-4b90-b466-274de732605c tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "interface-2f2d4e39-0c45-448e-add7-f053858edd8c-297cf87f-2f0f-4e71-be86-bae4e65887eb" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.726s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62c084-c531-48cb-9d5d-c425b456cf24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669b5c1-71dc-4f22-967d-fc97ec820a9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19c4b53-5db3-4415-857a-47052bf4abb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:33 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Creating config drive at /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/disk.config
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6i4o7cza {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:33 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5ed7e-002c-4efa-9b4e-35296c15c79e]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG os_brick.utils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6i4o7cza" returned: 0 in 0.065s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:33 user nova-compute[73458]: INFO nova.compute.manager [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Swapping volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 for 38295a3c-b724-4c01-8ce7-f80250dfab51
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] Acquiring lock "9613067b-3440-4584-a2a2-38535e913dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] Lock "9613067b-3440-4584-a2a2-38535e913dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] No waiting events found dispatching network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:33 user nova-compute[73458]: WARNING nova.compute.manager [req-75d4c6e9-6b69-4ede-adbc-e76108c52f2a req-5b1fcc68-8141-4a35-b111-46f0a69d4442 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received unexpected event network-vif-plugged-3685bf83-03cd-4f89-bffc-e6c1f74dde2f for instance with vm_state active and task_state deleting.
Aug 27 00:51:33 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Took 1.47 seconds to deallocate network for instance.
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.objects.instance [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lazy-loading 'flavor' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1388d1c3-4469-4922-88df-d15050eb936c tempest-VolumesAssistedSnapshotsTest-968698399 tempest-VolumesAssistedSnapshotsTest-968698399-project-admin] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.948s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Preparing to wait for external event volume-reimaged-b153e901-0356-4a3b-964f-3f17ee111a82 {{(pid=73458) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:33 user nova-compute[73458]: WARNING nova.compute.manager [req-6e8affd2-8004-475c-92c9-aa4ce1bda04f req-ab2df2dc-2420-452f-b073-0679c7a4cc63 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-297cf87f-2f0f-4e71-be86-bae4e65887eb for instance with vm_state active and task_state None.
Aug 27 00:51:34 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Deleted allocations for instance 9613067b-3440-4584-a2a2-38535e913dce
Aug 27 00:51:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c733805a-b399-4ea2-ab8a-49e8cbcd572f tempest-AttachSCSIVolumeTestJSON-1958255642 tempest-AttachSCSIVolumeTestJSON-1958255642-project-member] Lock "9613067b-3440-4584-a2a2-38535e913dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.067s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-d962e9cc-9815-462e-bb5e-ce9aef8dfdc5 req-3fc60608-b7c0-405b-9f37-f6cfa4b6fcf0 service nova] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Received event network-vif-deleted-3685bf83-03cd-4f89-bffc-e6c1f74dde2f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:36 user nova-compute[73458]: WARNING nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 for instance with vm_state building and task_state spawning.
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:36 user nova-compute[73458]: WARNING nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 for instance with vm_state building and task_state spawning.
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:36 user nova-compute[73458]: WARNING nova.compute.manager [req-88f4212c-804d-43eb-83a3-6c19fe25bc6d req-9dfbff1e-2a7a-4814-b5e1-1a8f1c41c949 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 for instance with vm_state building and task_state spawning.
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:36 user nova-compute[73458]: WARNING nova.compute.manager [req-f863cf11-f65b-481f-b4b4-ef7fcacd18c1 req-76b124c2-c1e1-41e4-88d8-ac99ade6132a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 for instance with vm_state building and task_state spawning.
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:37 user nova-compute[73458]: WARNING nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb for instance with vm_state building and task_state spawning.
Aug 27 00:51:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:37 user nova-compute[73458]: WARNING nova.compute.manager [req-91434c09-c431-429f-8efd-a7a5c8ac79e1 req-5534aca9-2fdb-48b9-8133-f7f97c6c4a16 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb for instance with vm_state building and task_state spawning.
Aug 27 00:51:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-36a6067e-3df6-4593-bd19-6d7d5afa7cbe req-e9a0ea5c-77d3-474b-b45b-bbdf1537e4ac service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:38 user nova-compute[73458]: WARNING nova.compute.manager [req-203a812f-7a09-4378-804f-9b300ffed07e req-68e60d8d-948d-4de4-879b-469833cf32dc service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 for instance with vm_state building and task_state spawning.
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097499.5199578, 3cc46c0f-ed32-4ad4-acea-c91399a3d883 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] VM Resumed (Lifecycle Event)
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance spawned successfully.
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097499.5236588, 3cc46c0f-ed32-4ad4-acea-c91399a3d883 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] VM Started (Lifecycle Event)
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Took 15.65 seconds to spawn the instance on the hypervisor.
Aug 27 00:51:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:51:39 user nova-compute[73458]: INFO nova.compute.manager [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Took 89.05 seconds to build instance.
Aug 27 00:51:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82d2caf4-86c2-4646-b6d0-31ff6e93e8dc tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 89.189s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:41 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097486.3786817, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:51:41 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Stopped (Lifecycle Event)
Aug 27 00:51:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ed2e418b-5b79-4bf1-ade6-c973987ffde0 None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing instance network info cache due to event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:51:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:46 user nova-compute[73458]: INFO nova.compute.manager [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Shelve offloading
Aug 27 00:51:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updated VIF entry in instance network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72fa7247-6c50-4a41-af3d-475b94adb382 req-3d85fa8e-98ba-4910-a92d-361bd89f2441 service nova] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097491.8778698, 9613067b-3440-4584-a2a2-38535e913dce => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:51:46 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9613067b-3440-4584-a2a2-38535e913dce] VM Stopped (Lifecycle Event)
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1ae7b50a-02a3-4b3c-aaac-6b9c8d9f5ab2 None None] [instance: 9613067b-3440-4584-a2a2-38535e913dce] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:46 user nova-compute[73458]: WARNING nova.compute.manager [req-b590ee82-9053-4dcd-92ec-0040aea43a10 req-0e2dd6ea-e530-4e24-b75b-f92f712f8cab service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state active and task_state shelving.
Aug 27 00:51:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance destroyed successfully.
Aug 27 00:51:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51', 'serial': '38295a3c-b724-4c01-8ce7-f80250dfab51'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 'serial'} {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:48 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:48 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:48 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea98aa39-36f9-4a5c-b501-3c3f94501839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:51:48 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67280d9f-40fd-4e19-be4b-263742bfd725]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51] added
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec39312-0d9d-460e-8c53-267ce0245fbf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.060s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ffbb44-a735-4d58-a091-23ccc073cbeb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance destroyed successfully.
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'resources' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwrRlkFX {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNr9+Bcj55+eAAbtn6uoPjvS3HJqBnQ5GIv/tanXPyPqjUCQh/QGAmuwaVq5tYljoyW+XlYSEJ96JRyHrfTnsoCS2rvs79uH0Anx3qMgM5HtufDcgnnbDLU+IKZ71FgGg==',key_name='tempest-TestShelveInstance-1424313510',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:14Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_vif [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing instance network info cache due to event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb535f02-31, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwrRlkFX" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d0aa6-28d9-4612-aa50-6f21497f4eb7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cwrRlkFX'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:51:48 user nova-compute[73458]: INFO os_vif [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31')
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:48 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[733cd29e-affa-4e92-b184-91ceb23661d1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[36249bec-7324-44c9-a1f6-e16c9aa92297]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc71eb-c73f-4685-8fd6-f9f2e9a1f62d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260]
Aug 27 00:51:48 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d550292-7418-4ff6-a997-051e463e13d8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7dda41-d09e-4d2a-979c-4f534a805d2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:48 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9af4ae-82ea-4670-9778-eab68fe8b1ab]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:51:48 user nova-compute[73458]: WARNING nova.compute.manager [req-6d937265-eb5e-4679-96f0-259fa804e27d req-3256ba74-0838-4246-bcd6-3f79298e46f3 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state active and task_state shelving.
Aug 27 00:51:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updated VIF entry in instance network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": null, "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcb535f02-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c20e8b9-cee9-4706-a948-96cae6bc8bda req-7020d34a-9615-493f-99d5-1e9d0161e176 service nova] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26333393764613331', 'path': '/dev/sdh'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333393764613331', 'path': '/dev/sdh'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lazy-loading 'flavor' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb16bdc-7d45-45e9-857b-e2278e61c161]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3a5c76-6331-4f5f-b357-089369cc6a32]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78687b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79745e31-a8d0-4231-b505-00599e607727]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a5b2e-9d00-4766-bd13-5d53945b7ada]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3250fc21-dd22-475a-9795-2fcfc9adf05d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[167106ec-e60f-41e5-9737-7b83d4d1dee5]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a64dbc-2bff-40d3-bcb8-26e65c8cf39b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[391e1f64-be28-417a-b13d-f7d3c2f6e302]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]
Aug 27 00:51:50 user nova-compute[73458]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c67207-55e8-4c34-a28e-e9a6407bfee9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== disconnect_volume: return (1673ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deleting instance files /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f_del
Aug 27 00:51:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deletion of /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f_del complete
Aug 27 00:51:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 171966464 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 307232768 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:52 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Deleted allocations for instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f
Aug 27 00:51:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'numa_topology' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.objects.base [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Object Instance<68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f> lazy-loaded attributes: resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 555745280 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 711983104 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:52 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:51:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.655s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-65a53dbf-54db-4658-8153-b950d17f563e tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.889s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 811597824 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 999292928 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca62073-7b21-419c-bae7-1863455f3181]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a282d3-f147-425e-8b74-6413f96ac7c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:51:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78687b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4af637-cad5-4636-856c-e357528b6d06]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323e5a2-801d-4288-ac5e-a84341c3ea01]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e04191c-ca04-445c-a140-c7e7f464e386]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd768d6-b05c-43ca-944f-b51de1f498ca]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88c9742-00c7-403b-9aab-832e548cf3f2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f865b-bf82-4f86-a7cc-018d145ba0a2]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]
Aug 27 00:51:55 user nova-compute[73458]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.
Aug 27 00:51:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af8a82d-6af2-4af0-a598-bab92a5baff9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== disconnect_volume: return (381ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51', 'serial'} {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 00:51:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: removing Cinder connection for volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 00:51:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: Updating volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "cwrRlkFX", "auth_password": "kbX9IBx0isyDrp", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "38295a3c-b724-4c01-8ce7-f80250dfab51"}, "status": "reserved", "instance": "c709b541-1fa2-406e-9210-fbfd4ac870ac", "attached_at": "", "detached_at": "", "volume_id": "38295a3c-b724-4c01-8ce7-f80250dfab51", "serial": "38295a3c-b724-4c01-8ce7-f80250dfab51"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51', 'no_device': None, 'attachment_id': '53f85d48-30a9-47db-8272-6555d384b390'} {{(pid=73458) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 00:51:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb2e3344-173d-4213-ac41-6c833e188491 tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.560s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.utils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a119697-0995-4fdf-a7a6-71490cc60cf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[580370a9-6de8-48cf-beb1-e852335ed466]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e11ef43-50fc-40f1-a300-314cad800a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed9b36-d5ab-4052-b552-5f5dd5929900]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:51:57 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:51:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87da9ab-4375-4f98-b961-ccd28b1f0e91]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:51:57 user nova-compute[73458]: DEBUG os_brick.utils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:51:57 user nova-compute[73458]: INFO nova.compute.manager [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Swapping volume 38295a3c-b724-4c01-8ce7-f80250dfab51 for 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4
Aug 27 00:51:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:51:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-5be60dc2-2033-4b21-9153-4746cc8fc074 req-a0cc889e-9add-486c-b9fc-c31ee477a90f service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event volume-reimaged-b153e901-0356-4a3b-964f-3f17ee111a82 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5be60dc2-2033-4b21-9153-4746cc8fc074 req-a0cc889e-9add-486c-b9fc-c31ee477a90f service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5be60dc2-2033-4b21-9153-4746cc8fc074 req-a0cc889e-9add-486c-b9fc-c31ee477a90f service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5be60dc2-2033-4b21-9153-4746cc8fc074 req-a0cc889e-9add-486c-b9fc-c31ee477a90f service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-5be60dc2-2033-4b21-9153-4746cc8fc074 req-a0cc889e-9add-486c-b9fc-c31ee477a90f service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Processing event volume-reimaged-b153e901-0356-4a3b-964f-3f17ee111a82 {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:52:00 user nova-compute[73458]: INFO nova.virt.block_device [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Booting with volume b153e901-0356-4a3b-964f-3f17ee111a82 at /dev/vda
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.utils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75192b6-e5d3-4c79-9beb-978e51cf4d19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b4e382-8a15-4b84-a83f-21f052637af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e2d9f-1064-4e97-a6da-19d4dc92ef41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ee551-c35e-46a3-94a6-20b895031b70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:00 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:52:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26abf9b9-e72e-403f-8bb9-0ffc5bd7c277]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG os_brick.utils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:00 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating existing volume attachment record: f0612ff0-249a-49f3-9e29-4104255336a7 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:52:01 user nova-compute[73458]: INFO nova.compute.claims [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Claim successful on node user
Aug 27 00:52:01 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:52:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097507.1210477, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:02 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Stopped (Lifecycle Event)
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-557dddc4-3af1-4a67-88fb-8042bc6655ed None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.policy [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15e8844b6f594cef9e904b88a6ca42b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd605e8ac6e749718ba402ae385a24bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:52:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Creating image(s)
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk 1073741824" returned: 0 in 0.051s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Successfully created port: 9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:52:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Cannot resize image /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Ensure instance console log exists: /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Successfully updated port: 9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing instance network info cache due to event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Instance network_info: |[{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Start _get_guest_xml network_info=[{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:52:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-108582497',display_name='tempest-ServerActionsTestOtherA-server-108582497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-108582497',id=13,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-krfyybzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=8fd76f35-50c9-4304-bad6-e72f01f03717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:52:04 user nova-compute[73458]:   <uuid>8fd76f35-50c9-4304-bad6-e72f01f03717</uuid>
Aug 27 00:52:04 user nova-compute[73458]:   <name>instance-0000000d</name>
Aug 27 00:52:04 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:52:04 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:52:04 user nova-compute[73458]:   <metadata>
Aug 27 00:52:04 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:52:04 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherA-server-108582497</nova:name>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:52:04</nova:creationTime>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:52:04 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:52:04 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:owner>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:user uuid="15e8844b6f594cef9e904b88a6ca42b9">tempest-ServerActionsTestOtherA-1449025138-project-member</nova:user>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:project uuid="bd605e8ac6e749718ba402ae385a24bd">tempest-ServerActionsTestOtherA-1449025138</nova:project>
Aug 27 00:52:04 user nova-compute[73458]:       </nova:owner>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:52:04 user nova-compute[73458]:       <nova:ports>
Aug 27 00:52:04 user nova-compute[73458]:         <nova:port uuid="9414b9b8-e694-48da-9851-32597aba7fc2">
Aug 27 00:52:04 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 00:52:04 user nova-compute[73458]:         </nova:port>
Aug 27 00:52:04 user nova-compute[73458]:       </nova:ports>
Aug 27 00:52:04 user nova-compute[73458]:     </nova:instance>
Aug 27 00:52:04 user nova-compute[73458]:   </metadata>
Aug 27 00:52:04 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:52:04 user nova-compute[73458]:     <system>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="serial">8fd76f35-50c9-4304-bad6-e72f01f03717</entry>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="uuid">8fd76f35-50c9-4304-bad6-e72f01f03717</entry>
Aug 27 00:52:04 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:52:04 user nova-compute[73458]:     </system>
Aug 27 00:52:04 user nova-compute[73458]:   </sysinfo>
Aug 27 00:52:04 user nova-compute[73458]:   <os>
Aug 27 00:52:04 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:52:04 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:52:04 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:52:04 user nova-compute[73458]:   </os>
Aug 27 00:52:04 user nova-compute[73458]:   <features>
Aug 27 00:52:04 user nova-compute[73458]:     <acpi/>
Aug 27 00:52:04 user nova-compute[73458]:     <apic/>
Aug 27 00:52:04 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:52:04 user nova-compute[73458]:   </features>
Aug 27 00:52:04 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:52:04 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:52:04 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:52:04 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:52:04 user nova-compute[73458]:   </clock>
Aug 27 00:52:04 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:52:04 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:52:04 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:52:04 user nova-compute[73458]:   </cpu>
Aug 27 00:52:04 user nova-compute[73458]:   <devices>
Aug 27 00:52:04 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:52:04 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:52:04 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk"/>
Aug 27 00:52:04 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:52:04 user nova-compute[73458]:     </disk>
Aug 27 00:52:04 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:52:04 user nova-compute[73458]:       <mac address="fa:16:3e:04:c0:70"/>
Aug 27 00:52:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:04 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:52:04 user nova-compute[73458]:       <target dev="tap9414b9b8-e6"/>
Aug 27 00:52:04 user nova-compute[73458]:     </interface>
Aug 27 00:52:04 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:52:04 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/console.log" append="off"/>
Aug 27 00:52:04 user nova-compute[73458]:     </serial>
Aug 27 00:52:04 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:52:04 user nova-compute[73458]:     <video>
Aug 27 00:52:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:04 user nova-compute[73458]:     </video>
Aug 27 00:52:04 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:52:04 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:52:04 user nova-compute[73458]:     </rng>
Aug 27 00:52:04 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:52:04 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:52:04 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:52:04 user nova-compute[73458]:     </memballoon>
Aug 27 00:52:04 user nova-compute[73458]:   </devices>
Aug 27 00:52:04 user nova-compute[73458]: </domain>
Aug 27 00:52:04 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-108582497',display_name='tempest-ServerActionsTestOtherA-server-108582497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-108582497',id=13,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-krfyybzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=8fd76f35-50c9-4304-bad6-e72f01f03717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG os_vif [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9414b9b8-e6, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9414b9b8-e6, col_values=(('external_ids', {'iface-id': '9414b9b8-e694-48da-9851-32597aba7fc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:c0:70', 'vm-uuid': '8fd76f35-50c9-4304-bad6-e72f01f03717'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:04 user nova-compute[73458]: INFO os_vif [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6')
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:52:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:04:c0:70, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:52:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated VIF entry in instance network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:52:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79e2454d-f905-4647-b4a2-58bc07380472 req-a2a1201d-4caa-4bfe-a92f-22974167dffe service nova] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] No waiting events found dispatching network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:06 user nova-compute[73458]: WARNING nova.compute.manager [req-21e4ddaa-28c7-45f7-8bb4-482223e4635c req-1cc46302-afa3-48a9-be05-e5b3eb0a0d47 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received unexpected event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 for instance with vm_state building and task_state spawning.
Aug 27 00:52:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] No waiting events found dispatching network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:08 user nova-compute[73458]: WARNING nova.compute.manager [req-62005074-d225-4745-9e4b-6a2dfd333b9c req-44c703d4-bea5-4adb-8728-2d171e1c3fae service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received unexpected event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 for instance with vm_state building and task_state spawning.
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097529.0823212, 8fd76f35-50c9-4304-bad6-e72f01f03717 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] VM Resumed (Lifecycle Event)
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Instance spawned successfully.
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097529.0860336, 8fd76f35-50c9-4304-bad6-e72f01f03717 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] VM Started (Lifecycle Event)
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 27 00:52:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:09 user nova-compute[73458]: INFO nova.compute.manager [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Took 7.77 seconds to build instance.
Aug 27 00:52:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d4eae06a-ae21-448b-92b4-d98b9c3d2fe3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.889s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:11 user nova-compute[73458]: INFO nova.compute.manager [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Terminating instance
Aug 27 00:52:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-unplugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] No waiting events found dispatching network-vif-unplugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-b10b19f5-0d48-4c28-b0e6-5aaf7dca3661 req-31b0dc26-52ca-4240-822c-1877d7601de9 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-unplugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 'serial': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51'}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51', 'serial'} {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:12 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:12 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:12 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[55917e6d-b927-4838-9f20-fd3f8a6147e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:52:12 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda4eb7-51b0-462d-8e6c-9cf474a05745]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4] added
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a0176-e450-4697-8322-b1f4f045ae05]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8938343-0424-48ad-846a-eb7a3458ad11]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQeBKSOL {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQeBKSOL" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0488174-9791-48c2-9e6c-1db295486c88]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQeBKSOL'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2490bd-0d31-4995-8dc4-0a36bbf2aa9c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[edda316f-a5dd-4070-bac6-dd684ee4a974]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba37c9-df2b-4bb1-8a30-fcd2a941b86b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]
Aug 27 00:52:12 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f77859-3d70-4414-88f2-0bdb2c2608e1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8516f60-80f7-44d0-8d77-9695c35a5b80]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Instance destroyed successfully.
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lazy-loading 'resources' on Instance uuid 2546394c-768a-4254-9a63-7cc0b91b6ed8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[69be47d5-88c5-41e2-80b4-75a2a75f82b7]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-248441373',display_name='tempest-ServersNegativeTestJSON-server-248441373',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-248441373',id=12,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-qbjs490g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:30Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=2546394c-768a-4254-9a63-7cc0b91b6ed8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "address": "fa:16:3e:80:a7:91", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40bb8258-e6", "ovs_interfaceid": "40bb8258-e61d-4090-83e4-fb73a6839fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG os_vif [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40bb8258-e6, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:12 user nova-compute[73458]: INFO os_vif [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:a7:91,bridge_name='br-int',has_traffic_filtering=True,id=40bb8258-e61d-4090-83e4-fb73a6839fa6,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40bb8258-e6')
Aug 27 00:52:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Deleting instance files /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8_del
Aug 27 00:52:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Deletion of /opt/stack/data/nova/instances/2546394c-768a-4254-9a63-7cc0b91b6ed8_del complete
Aug 27 00:52:12 user nova-compute[73458]: INFO nova.compute.manager [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 00:52:12 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:52:12 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:13 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Took 0.53 seconds to deallocate network for instance.
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-015fb386-dd63-4ab3-a197-f0c93538d244 req-a7fad7fc-3d95-4bc0-a001-e09ce18463b7 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-deleted-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26232343633393164', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232343633393164', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lazy-loading 'flavor' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:13 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:14 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Deleted allocations for instance 2546394c-768a-4254-9a63-7cc0b91b6ed8
Aug 27 00:52:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ed6513a9-bb18-494d-866c-77ad19bbf155 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] Acquiring lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] Lock "2546394c-768a-4254-9a63-7cc0b91b6ed8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] No waiting events found dispatching network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:14 user nova-compute[73458]: WARNING nova.compute.manager [req-1c4c1d64-afdc-4fc3-bb51-72a12d516b9a req-69d88b76-7e50-456e-8429-faad2606b7a6 service nova] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Received unexpected event network-vif-plugged-40bb8258-e61d-4090-83e4-fb73a6839fa6 for instance with vm_state deleted and task_state None.
Aug 27 00:52:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 333447168 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 491782144 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:52:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Creating image(s)
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start _get_guest_xml network_info=[{"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7492f540-2a69-463c-82f7-9ea78fc6c8a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'b153e901-0356-4a3b-964f-3f17ee111a82', 'serial': 'b153e901-0356-4a3b-964f-3f17ee111a82'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'f0612ff0-249a-49f3-9e29-4104255336a7', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:52:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 00:52:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7492f540-2a69-463c-82f7-9ea78fc6c8a6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:15 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:15 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:15 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd960755-5812-4382-b021-a0b7fb1252e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:52:15 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b00fa0-8b6e-46ad-b420-ef47dec8880c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82] added
Aug 27 00:52:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a2965-4e6b-4056-a572-d38dded4b137]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fdfc4-4475-4a0c-b3bc-9dc2e5680afb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQzdXYKu {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQzdXYKu" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93be2fd-baa9-42d5-959b-c43b0e8860ef]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQzdXYKu'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e1c82-e0cb-4ac6-b786-c7cc70c73545]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f86e0d-a083-4b14-9fb9-be9a3dfb853d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc63c5ce-187e-4d05-8f3a-173f6fd50247]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]
Aug 27 00:52:16 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[899164bb-ee8e-4853-8885-fab4d8150e4a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 608174080 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[64919261-401a-4e4f-b339-95bd688b19d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[280658df-5dc9-4bc8-a1f0-4904ede4601a]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:52:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 922746880 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23437373036623134', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437373036623134', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1402922038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:52:17 user nova-compute[73458]:   <uuid>7492f540-2a69-463c-82f7-9ea78fc6c8a6</uuid>
Aug 27 00:52:17 user nova-compute[73458]:   <name>instance-00000008</name>
Aug 27 00:52:17 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:52:17 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:52:17 user nova-compute[73458]:   <metadata>
Aug 27 00:52:17 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:52:17 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:52:17 user nova-compute[73458]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1402922038</nova:name>
Aug 27 00:52:17 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:52:15</nova:creationTime>
Aug 27 00:52:17 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:52:17 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:52:17 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:52:17 user nova-compute[73458]:       <nova:owner>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:user uuid="ad6b59eaab96447e885ff14e644aaf5b">tempest-ServerActionsV293TestJSON-1142258299-project-member</nova:user>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:project uuid="7af9bf87985e40759127eaa701c05d67">tempest-ServerActionsV293TestJSON-1142258299</nova:project>
Aug 27 00:52:17 user nova-compute[73458]:       </nova:owner>
Aug 27 00:52:17 user nova-compute[73458]:       <nova:ports>
Aug 27 00:52:17 user nova-compute[73458]:         <nova:port uuid="d38e00a5-6077-4aa3-bfea-7897c6fa733a">
Aug 27 00:52:17 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 00:52:17 user nova-compute[73458]:         </nova:port>
Aug 27 00:52:17 user nova-compute[73458]:       </nova:ports>
Aug 27 00:52:17 user nova-compute[73458]:     </nova:instance>
Aug 27 00:52:17 user nova-compute[73458]:   </metadata>
Aug 27 00:52:17 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:52:17 user nova-compute[73458]:     <system>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="serial">7492f540-2a69-463c-82f7-9ea78fc6c8a6</entry>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="uuid">7492f540-2a69-463c-82f7-9ea78fc6c8a6</entry>
Aug 27 00:52:17 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:52:17 user nova-compute[73458]:     </system>
Aug 27 00:52:17 user nova-compute[73458]:   </sysinfo>
Aug 27 00:52:17 user nova-compute[73458]:   <os>
Aug 27 00:52:17 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:52:17 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:52:17 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:52:17 user nova-compute[73458]:   </os>
Aug 27 00:52:17 user nova-compute[73458]:   <features>
Aug 27 00:52:17 user nova-compute[73458]:     <acpi/>
Aug 27 00:52:17 user nova-compute[73458]:     <apic/>
Aug 27 00:52:17 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:52:17 user nova-compute[73458]:   </features>
Aug 27 00:52:17 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:52:17 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:52:17 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:52:17 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:52:17 user nova-compute[73458]:   </clock>
Aug 27 00:52:17 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:52:17 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:52:17 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:52:17 user nova-compute[73458]:   </cpu>
Aug 27 00:52:17 user nova-compute[73458]:   <devices>
Aug 27 00:52:17 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:52:17 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:52:17 user nova-compute[73458]:       <source dev="/dev/sdc"/>
Aug 27 00:52:17 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:52:17 user nova-compute[73458]:       <serial>b153e901-0356-4a3b-964f-3f17ee111a82</serial>
Aug 27 00:52:17 user nova-compute[73458]:     </disk>
Aug 27 00:52:17 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:52:17 user nova-compute[73458]:       <mac address="fa:16:3e:94:ee:16"/>
Aug 27 00:52:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:17 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:52:17 user nova-compute[73458]:       <target dev="tapd38e00a5-60"/>
Aug 27 00:52:17 user nova-compute[73458]:     </interface>
Aug 27 00:52:17 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:52:17 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6/console.log" append="off"/>
Aug 27 00:52:17 user nova-compute[73458]:     </serial>
Aug 27 00:52:17 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:52:17 user nova-compute[73458]:     <video>
Aug 27 00:52:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:17 user nova-compute[73458]:     </video>
Aug 27 00:52:17 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:52:17 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:52:17 user nova-compute[73458]:     </rng>
Aug 27 00:52:17 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:52:17 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:52:17 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:52:17 user nova-compute[73458]:     </memballoon>
Aug 27 00:52:17 user nova-compute[73458]:   </devices>
Aug 27 00:52:17 user nova-compute[73458]: </domain>
Aug 27 00:52:17 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1402922038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG os_vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd38e00a5-60, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd38e00a5-60, col_values=(('external_ids', {'iface-id': 'd38e00a5-6077-4aa3-bfea-7897c6fa733a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:ee:16', 'vm-uuid': '7492f540-2a69-463c-82f7-9ea78fc6c8a6'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:17 user nova-compute[73458]: INFO os_vif [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60')
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] No VIF found with MAC fa:16:3e:94:ee:16, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:52:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 1069547520 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwrRlkFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '38295a3c-b724-4c01-8ce7-f80250dfab51'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:18 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[453c01f6-30f2-4c55-9492-c392d1264a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b85b3b-d807-4fc7-a146-5e8092f6cb9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e99339bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51'): ({'sdh'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Removing single pathed devices sdh {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f89a2e-e83f-41c8-8e5d-19e5bfdf0c46]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e039cd-9160-427b-a918-bb8555e9fa95]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Flushing IO for device /dev/sdh {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e798436-c0bc-4495-91b6-2c5057ddc1b6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4961b4a1-a5f8-47ac-a984-50ddb5035ed6]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba60f4d-5d51-4180-a30d-19a0c094ccea]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a466a79-4c28-4221-bb1a-197c72953462]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260]
Aug 27 00:52:18 user nova-compute[73458]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38295a3c-b724-4c01-8ce7-f80250dfab51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adfc3e6-c8d5-4bae-9eba-02fa6451e1aa]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] <== disconnect_volume: return (390ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c709b541-1fa2-406e-9210-fbfd4ac870ac', 'attached_at': '', 'detached_at': '', 'volume_id': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 'serial'} {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: removing Cinder connection for volume 38295a3c-b724-4c01-8ce7-f80250dfab51 {{(pid=73458) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:19 user nova-compute[73458]: WARNING nova.compute.manager [req-d090855a-ccba-4928-abfb-680a2a6f67e8 req-3803efdc-cd79-4ae8-a98d-7e349ac71adb service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state rebuild_spawning.
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097541.3108988, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Resumed (Lifecycle Event)
Aug 27 00:52:21 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance spawned successfully.
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:21 user nova-compute[73458]: WARNING nova.compute.manager [req-d1b5c655-92c8-4f8f-9281-c435a2331248 req-956a87fc-30fd-4921-a8ea-1905c60ed08e service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state rebuild_spawning.
Aug 27 00:52:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097541.311041, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Started (Lifecycle Event)
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73458) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5be60dc2-2033-4b21-9153-4746cc8fc074 tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.097s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:22 user nova-compute[73458]: INFO nova.compute.manager [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Terminating instance
Aug 27 00:52:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-unplugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-unplugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-530d38f7-902b-486f-a9cf-8d2a652ba53c req-1f394b0a-39d4-4d6a-9edc-5a2af7952f82 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-unplugged-0c2bca75-976d-49fe-a789-30aacb954db8 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Instance destroyed successfully.
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lazy-loading 'resources' on Instance uuid 2f2d4e39-0c45-448e-add7-f053858edd8c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1711372017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1711372017',id=5,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuuMS3OfIcRfBaFMD7lDHIs7hv2w7SrT/aXmk3C83bBg/hrxP7IWr23AUF071sqERF7iy0Y66MShS8EhdrX85+Kh7FsdWeI4GXpLqcPvYa8UuujRvaJEpnC9sQuExoDxg==',key_name='tempest-keypair-1597764943',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f191e470513741d7b951be664ca14122',ramdisk_id='',reservation_id='r-y1060n0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-873623990',owner_user_name='tempest-TaggedAttachmentsTest-873623990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a77564556f9e41ff9bbe4e77d9c08c4d',uuid=2f2d4e39-0c45-448e-add7-f053858edd8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converting VIF {"id": "0c2bca75-976d-49fe-a789-30aacb954db8", "address": "fa:16:3e:4b:0e:c3", "network": {"id": "ef11fb08-9d94-4865-9a24-27ceeea55c6e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-57515082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f191e470513741d7b951be664ca14122", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c2bca75-97", "ovs_interfaceid": "0c2bca75-976d-49fe-a789-30aacb954db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG os_vif [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c2bca75-97, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:23 user nova-compute[73458]: INFO os_vif [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=0c2bca75-976d-49fe-a789-30aacb954db8,network=Network(ef11fb08-9d94-4865-9a24-27ceeea55c6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c2bca75-97')
Aug 27 00:52:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Deleting instance files /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c_del
Aug 27 00:52:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Deletion of /opt/stack/data/nova/instances/2f2d4e39-0c45-448e-add7-f053858edd8c_del complete
Aug 27 00:52:23 user nova-compute[73458]: INFO nova.compute.manager [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'flavor' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:24 user nova-compute[73458]: INFO nova.compute.manager [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Attaching volume 3e6cde00-d755-4505-950f-29c7eff8f633 to /dev/vdb
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG os_brick.utils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3687429-782c-47ea-a4c9-cbaa05af5003]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c731ab8d-7b0e-43dd-a8cc-b96c5108ca1d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e9481-5f01-4d8c-8f56-1aab6402e179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e3c18-74f9-40be-88fc-447f8ec3ed69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:25 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3410f85-c2a5-482d-8c31-74c4af5846cc]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] Acquiring lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] No waiting events found dispatching network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:25 user nova-compute[73458]: WARNING nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received unexpected event network-vif-plugged-0c2bca75-976d-49fe-a789-30aacb954db8 for instance with vm_state active and task_state deleting.
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Received event network-vif-deleted-0c2bca75-976d-49fe-a789-30aacb954db8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:25 user nova-compute[73458]: INFO nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Neutron deleted interface 0c2bca75-976d-49fe-a789-30aacb954db8; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG os_brick.utils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== get_connector_properties: return (849ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating existing volume attachment record: c0fb8875-efa9-40b7-ba99-ef6b9b366f08 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:52:25 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Took 1.96 seconds to deallocate network for instance.
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae3625dd-68bb-40fc-b88d-0f36cec102e5 req-9136e2eb-bbdb-41dc-a882-b3995c5692e9 service nova] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Detach interface failed, port_id=0c2bca75-976d-49fe-a789-30aacb954db8, reason: Instance 2f2d4e39-0c45-448e-add7-f053858edd8c could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7418MB free_disk=25.797958374023438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2f2d4e39-0c45-448e-add7-f053858edd8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b7b683b7-a32c-42ee-9ee0-10bb03611810 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c709b541-1fa2-406e-9210-fbfd4ac870ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.450s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:26 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Deleted allocations for instance 2f2d4e39-0c45-448e-add7-f053858edd8c
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dce4b835-6b12-4603-bc87-48fd4a73f18b tempest-TaggedAttachmentsTest-873623990 tempest-TaggedAttachmentsTest-873623990-project-member] Lock "2f2d4e39-0c45-448e-add7-f053858edd8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.331s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:52:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:52:27 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097532.753841, 2546394c-768a-4254-9a63-7cc0b91b6ed8 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:27 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] VM Stopped (Lifecycle Event)
Aug 27 00:52:27 user nova-compute[73458]: DEBUG nova.compute.manager [None req-563f9bd4-e1fe-490a-9c4e-17ef4b1703c4 None None] [instance: 2546394c-768a-4254-9a63-7cc0b91b6ed8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:30 user nova-compute[73458]: INFO nova.compute.manager [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Terminating instance
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-unplugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] No waiting events found dispatching network-vif-unplugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-fe5b13fb-18b6-40f3-b183-23d0719a486a req-02dc283e-c6dc-456c-a596-9d487486194c service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-unplugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Instance destroyed successfully.
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lazy-loading 'resources' on Instance uuid b7b683b7-a32c-42ee-9ee0-10bb03611810 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1427813982',display_name='tempest-VolumesAssistedSnapshotsTest-server-1427813982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1427813982',id=6,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEKdJTs5hhChu9U3Yfp1lH3/pjxHWf4ap4NRvA5/UGQY9z/BwSnhBuRmjElbeetRUFPUmKhZPqPVco2edlhUAdCEjHxw/BhsrMBuqCz1apFycwIEaCcno6CJJmzECm/9Q==',key_name='tempest-keypair-662515319',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e36f8db7ce1e447fa34b1f73c271ea0a',ramdisk_id='',reservation_id='r-1zx3175t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-714309587',owner_user_name='tempest-VolumesAssistedSnapshotsTest-714309587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bafa02029a1147549da86df0613c9c36',uuid=b7b683b7-a32c-42ee-9ee0-10bb03611810,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:30 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converting VIF {"id": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "address": "fa:16:3e:56:17:5b", "network": {"id": "0b5da462-8b73-4f44-bfbb-36e787848e60", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-718866734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e36f8db7ce1e447fa34b1f73c271ea0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8414ef-1d", "ovs_interfaceid": "7e8414ef-1dbd-4753-bb49-b5291bb84ad8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG os_vif [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8414ef-1d, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:31 user nova-compute[73458]: INFO os_vif [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:17:5b,bridge_name='br-int',has_traffic_filtering=True,id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8,network=Network(0b5da462-8b73-4f44-bfbb-36e787848e60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8414ef-1d')
Aug 27 00:52:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Deleting instance files /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810_del
Aug 27 00:52:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Deletion of /opt/stack/data/nova/instances/b7b683b7-a32c-42ee-9ee0-10bb03611810_del complete
Aug 27 00:52:31 user nova-compute[73458]: INFO nova.compute.manager [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 00:52:31 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] swap_volume: Updating volume 38295a3c-b724-4c01-8ce7-f80250dfab51 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "pQeBKSOL", "auth_password": "CZOe2NKUF1sg9i", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4"}, "status": "reserved", "instance": "c709b541-1fa2-406e-9210-fbfd4ac870ac", "attached_at": "", "detached_at": "", "volume_id": "71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4", "serial": "71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 'no_device': None, 'attachment_id': 'd8f5fe77-96bd-47dc-974e-055f7208edb3'} {{(pid=73458) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 00:52:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-79855e58-04c8-40f1-8b12-5fa2a7fc203d tempest-TestVolumeSwap-2073566831 tempest-TestVolumeSwap-2073566831-project-admin] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 33.878s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-74ea78cb-da4c-44f8-9109-688bdd616a39 req-8cf3e997-eff0-4cd5-a96c-357485bb35eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-deleted-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.compute.manager [req-74ea78cb-da4c-44f8-9109-688bdd616a39 req-8cf3e997-eff0-4cd5-a96c-357485bb35eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Neutron deleted interface 7e8414ef-1dbd-4753-bb49-b5291bb84ad8; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-74ea78cb-da4c-44f8-9109-688bdd616a39 req-8cf3e997-eff0-4cd5-a96c-357485bb35eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Took 1.21 seconds to deallocate network for instance.
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-74ea78cb-da4c-44f8-9109-688bdd616a39 req-8cf3e997-eff0-4cd5-a96c-357485bb35eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Detach interface failed, port_id=7e8414ef-1dbd-4753-bb49-b5291bb84ad8, reason: Instance b7b683b7-a32c-42ee-9ee0-10bb03611810 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.compute.manager [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Detaching volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] Acquiring lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] No waiting events found dispatching network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:32 user nova-compute[73458]: WARNING nova.compute.manager [req-1e9832a2-05d7-4b45-ad87-dd76d0eb353d req-d83e8b3f-3393-4187-965f-a02080f305eb service nova] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Received unexpected event network-vif-plugged-7e8414ef-1dbd-4753-bb49-b5291bb84ad8 for instance with vm_state deleted and task_state None.
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.virt.block_device [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Attempting to driver detach volume 71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 from mountpoint /dev/vdb
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Deleted allocations for instance b7b683b7-a32c-42ee-9ee0-10bb03611810
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Attempting to detach device vdb from instance c709b541-1fa2-406e-9210-fbfd4ac870ac from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:52:32 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:52:32 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:52:32 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:52:32 user nova-compute[73458]:   <serial>71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4</serial>
Aug 27 00:52:32 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:52:32 user nova-compute[73458]: </disk>
Aug 27 00:52:32 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:52:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Successfully detached device vdb from instance c709b541-1fa2-406e-9210-fbfd4ac870ac from the persistent domain config.
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c709b541-1fa2-406e-9210-fbfd4ac870ac from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:52:32 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:52:32 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:52:32 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:52:32 user nova-compute[73458]:   <serial>71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4</serial>
Aug 27 00:52:32 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:52:32 user nova-compute[73458]: </disk>
Aug 27 00:52:32 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:52:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8bf440a5-6f8f-4cc2-b77e-46283fb8fde4 tempest-VolumesAssistedSnapshotsTest-714309587 tempest-VolumesAssistedSnapshotsTest-714309587-project-member] Lock "b7b683b7-a32c-42ee-9ee0-10bb03611810" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097553.3382437, c709b541-1fa2-406e-9210-fbfd4ac870ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:52:33 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Successfully detached device vdb from instance c709b541-1fa2-406e-9210-fbfd4ac870ac from the live domain config.
Aug 27 00:52:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQeBKSOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:33 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b8321-2d1b-4186-9526-e816a1cacd9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8206e8-9657-4c04-ac13-2e187a46ad27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e980a5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea805cb-833a-45b5-bb49-6b66cc7532bf]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e767667-972c-498c-a455-6f28b4921047]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3190de34-9951-4575-9410-215709a7bdfc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[53338383-9d82-4a4b-95a0-3638791b28c8]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b44b41-222e-42e9-a081-35ca3e8b08c3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[52720ae4-ab88-47f8-9114-ecb591e724ba]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260]
Aug 27 00:52:33 user nova-compute[73458]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71985e1e-66ab-40d6-9afc-8c2eb7d0a0d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd0656-4a71-4e53-ac80-7de8b14c35af]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] <== disconnect_volume: return (349ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:34 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lazy-loading 'flavor' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cb07c6dd-81e1-4aa5-9ccc-835662239508 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.873s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097543.2132828, 2f2d4e39-0c45-448e-add7-f053858edd8c => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:38 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] VM Stopped (Lifecycle Event)
Aug 27 00:52:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-277e767a-28d2-4f82-9d0d-7063e76ff3de None None] [instance: 2f2d4e39-0c45-448e-add7-f053858edd8c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:38 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02a36f7-fced-4539-b6b4-1f49371022cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:52:38 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdb77c9-9abc-4824-966f-afe0f747f6b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added
Aug 27 00:52:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf861a08-b807-4b92-b1d7-4980a889d741]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a8a68-60a6-4788-a7f1-d70509c7b0c5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a28d5-17f4-421e-98ea-d79b51e6d878]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heVmybSO'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[01975671-e42a-4379-8fea-1f287bdb44fc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037b5aa-7e3e-4e81-a50c-635ac2aeb9d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a8941e-d3a8-41fc-bb7e-f134f554bef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:52:39 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac491707-acac-4994-b525-75f4341f5e64]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[485ecaaf-17f8-41e2-97bc-79514048021f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f2d8f2-713c-43c5-baff-2e1a7df435c5]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:52:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'flavor' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:52:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:52:40 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:52:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:52:40 user nova-compute[73458]:   <serial>3e6cde00-d755-4505-950f-29c7eff8f633</serial>
Aug 27 00:52:40 user nova-compute[73458]: </disk>
Aug 27 00:52:40 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-changed-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing instance network info cache due to event network-changed-eeb32caf-3b94-4439-95c7-059a4b58184a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] Acquiring lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] Acquired lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Refreshing network info cache for port eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No VIF found with MAC fa:16:3e:e4:e1:1e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:52:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb5b35e0-b9f6-4a8c-94a7-96f4c32f271d tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.648s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updated VIF entry in instance network info cache for port eeb32caf-3b94-4439-95c7-059a4b58184a. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:52:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3b0ca2ac-6ad5-4042-a726-05d68742b32e req-73ce84b1-08dc-49c1-ae2e-ddeb06cdaa23 service nova] Releasing lock "refresh_cache-eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:42 user nova-compute[73458]: INFO nova.compute.manager [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Terminating instance
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Stashing vm_state: active {{(pid=73458) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:52:43 user nova-compute[73458]: INFO nova.compute.claims [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Claim successful on node user
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating resource usage from migration cc11fdd5-a118-433d-ab59-6ae612211627
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-72920482-2de9-46d7-b74c-a85b538e76e7 req-5454ca63-6e87-4da1-9017-dbfecf3afbfc service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-32e150ed-aaaf-41cf-b708-0938de0cf45b req-c18bd037-3204-4e48-8230-1a8dc8c22ac5 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-93581884-34c5-4660-8528-efde56489ce1 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-abdb9cd7-5af8-45ff-b047-df22d8cf4130 req-e2a286e4-bc89-4936-9509-ed9c72464fae service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-eeb32caf-3b94-4439-95c7-059a4b58184a for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.660s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:43 user nova-compute[73458]: INFO nova.compute.manager [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Migrating
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: INFO nova.compute.rpcapi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG nova.network.neutron [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:52:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Instance destroyed successfully.
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.objects.instance [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lazy-loading 'resources' on Instance uuid eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Starting migrate_disk_and_power_off {{(pid=73458) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb32caf-3b, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1d:8c,bridge_name='br-int',has_traffic_filtering=True,id=eeb32caf-3b94-4439-95c7-059a4b58184a,network=Network(f29a75af-bf0e-49fa-a8ec-10bdd92eaa19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb32caf-3b')
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8273494a-e8, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:d9,bridge_name='br-int',has_traffic_filtering=True,id=8273494a-e8c0-4f52-a7bf-1b44497c06fb,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8273494a-e8')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93581884-34, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d5:ef,bridge_name='br-int',has_traffic_filtering=True,id=93581884-34c5-4660-8528-efde56489ce1,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap93581884-34')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "d566bacb-d803-4100-825b-e11a4179daf2", "address": "fa:16:3e:10:db:e1", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd566bacb-d8", "ovs_interfaceid": "d566bacb-d803-4100-825b-e11a4179daf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd566bacb-d8, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:e1,bridge_name='br-int',has_traffic_filtering=True,id=d566bacb-d803-4100-825b-e11a4179daf2,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd566bacb-d8')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1fa2b4f-da, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:bb:4d,bridge_name='br-int',has_traffic_filtering=True,id=b1fa2b4f-da94-416b-a093-731b3a8e404f,network=Network(1112e3e2-3382-4d44-b316-97b324e49c2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1fa2b4f-da')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8d6a41a-f0, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:4c:05,bridge_name='br-int',has_traffic_filtering=True,id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8d6a41a-f0')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1419851038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1419851038',id=10,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyBfYMS2jaVCijAOKO8o2m1BGc/GQSXd2Jx61GeONUv7uGeQDcUkSf5JiXoL22OE+tvGDWzxdWMJ0OtkqV3ZpDTKQx2LtfrB4vU5k1+DjmPCrT3YXJQE/502/qjKk3yXQ==',key_name='tempest-keypair-1118827684',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729dc2ba91944395b5210cb5ed43d1ea',ramdisk_id='',reservation_id='r-va2y9whq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-354487124',owner_user_name='tempest-TaggedBootDevicesTest_v242-354487124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8b69053519142e79e98924e9c929424',uuid=eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converting VIF {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d102021-81, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:bd:89,bridge_name='br-int',has_traffic_filtering=True,id=9d102021-81e6-4551-9db7-bd7e29adb1b6,network=Network(fcd48fce-2dd7-4ac9-8753-7ec56fd9355e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d102021-81')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfdzBFwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6bd269-00f2-4cf1-afcf-6bf2c84b63dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487aec0-6902-42a7-a26a-d00a772b4048]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78506050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a54c3f-52d0-4b6d-a95e-7e1575ff8b91]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING nova.compute.manager [req-110ae900-baba-4735-8e80-59fb48860fc6 req-8c0da8ea-838f-4153-8e7b-100e90f99bac service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-8273494a-e8c0-4f52-a7bf-1b44497c06fb for instance with vm_state active and task_state deleting.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[89383075-b04b-4c82-98f6-e7f9d87584b2]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9e51b7-5406-4d9a-86dd-ae540d09c618]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance destroyed successfully.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a1c5ef-9f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: INFO os_vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cf2c28-2846-48fb-be96-a6996fa2ab8f]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[615c22c7-173f-4efc-81c2-c021bc2f5fc4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d1f76-43dc-46e6-b969-8d7a5724f8bb]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260]
Aug 27 00:52:45 user nova-compute[73458]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-93581884-34c5-4660-8528-efde56489ce1 for instance with vm_state active and task_state deleting.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING nova.compute.manager [req-867dd2f5-dd0a-4245-976e-258de93e0219 req-6c9f901b-c718-43ff-a000-f68d67c7b126 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa for instance with vm_state active and task_state deleting.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-eeb32caf-3b94-4439-95c7-059a4b58184a for instance with vm_state active and task_state deleting.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-d566bacb-d803-4100-825b-e11a4179daf2 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING nova.compute.manager [req-c560d199-a247-4c6d-9125-1f4c4bc2bd25 req-d9c817e2-7c62-4cfd-9083-fc57900bd667 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-d566bacb-d803-4100-825b-e11a4179daf2 for instance with vm_state active and task_state deleting.
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9cd4eff-80a6-4d3c-848c-5dc1bb109038 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3f65aa-10b1-45ca-9529-cc42b67e249c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== disconnect_volume: return (392ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.144s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcFazAej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6aa01-50e3-4f77-82d9-949f16834e21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd920172-2fbc-4833-a7bc-693fe4b0a74b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e980a5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097550.9723237, b7b683b7-a32c-42ee-9ee0-10bb03611810 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:45 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] VM Stopped (Lifecycle Event)
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[22138433-ca46-4c38-ba02-39e61b92c69a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dfc5df76-aaf4-4b06-826d-5b273918443a None None] [instance: b7b683b7-a32c-42ee-9ee0-10bb03611810] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff36bfd-fbdc-4134-8968-ef92c5255164]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[97099bf9-a202-451b-98cf-990aeb2acb20]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f12843-8b42-4cf1-ab12-138950b7a8fe]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d8a49-4298-4ad4-b42c-5aa4ecebc43a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[877d9abc-b392-4bf0-a537-38fe48fd191c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:52:46 user nova-compute[73458]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9ec403-9ac8-4148-98d2-e12bc8ff9d5b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== disconnect_volume: return (463ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.316s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dacd6fe-2a2b-4fc4-b369-2b722b1022ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896448c-f7df-45eb-8648-e5ffb27b949e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9e9ef010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08'): ({'sdf'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Removing single pathed devices sdf {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cd4777-1f19-4671-92da-1fb29533de6e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[45159f3b-b441-4f18-b3d3-692c15b87acd]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Flushing IO for device /dev/sdf {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1addc5bd-c5cf-4c72-b17e-8ad84f45699b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1fb146-091f-49b3-91c7-f99ba7898b36]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] SCSI volumes sdf have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[44be1f4a-aef4-44ae-a512-1662496a831d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a86da78-b474-4d8b-83a9-791181fa8829]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260]
Aug 27 00:52:46 user nova-compute[73458]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bc5133f-4edd-4410-b8dd-a45d41659f08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35353a37-7d24-469c-99bc-07d9d732f059]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== disconnect_volume: return (729ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvFVyCTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:46 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_resize/disk /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5803ae2-8f94-4112-a6f3-0bbd21fb1d4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67adf948-022c-4f6e-acd9-c1e52a15da1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 (non-flash)
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786d4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d8815-71ce-436e-9e67-c05cac23582a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[910366f4-e4fd-4c5b-959a-aa09ba71695b]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1907ec8-e49d-49b4-b4eb-10ccc9de139b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55c82c-8a7f-471e-a857-174e78cdbe3b]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[512c9095-935b-434b-924d-12fb57577c4f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d784ad-d3e4-46c5-8212-ede72db254e0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260]
Aug 27 00:52:46 user nova-compute[73458]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e978bb0e-d6bd-43f4-bbaa-6b071d22f8d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[667bb15a-cac0-4918-b7c0-7c763ee5e8b8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] <== disconnect_volume: return (350ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Deleting instance files /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f_del
Aug 27 00:52:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Deletion of /opt/stack/data/nova/instances/eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f_del complete
Aug 27 00:52:47 user nova-compute[73458]: INFO nova.compute.manager [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Took 4.09 seconds to destroy the instance on the hypervisor.
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "cp -r /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_resize/disk /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk" returned: 0 in 0.615s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_resize/disk.info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk.info {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "cp -r /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_resize/disk.info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk.info" returned: 0 in 0.033s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-b1fa2b4f-da94-416b-a093-731b3a8e404f for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:48 user nova-compute[73458]: WARNING nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-b1fa2b4f-da94-416b-a093-731b3a8e404f for instance with vm_state active and task_state deleting.
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-unplugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-unplugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Acquiring lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] No waiting events found dispatching network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:48 user nova-compute[73458]: WARNING nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received unexpected event network-vif-plugged-9d102021-81e6-4551-9db7-bd7e29adb1b6 for instance with vm_state active and task_state deleting.
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:48 user nova-compute[73458]: WARNING nova.compute.manager [req-40135eac-7e59-4c53-8a25-63606495cf3c req-4b385661-47d0-4066-a107-ea7c4311919a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state resize_migrating.
Aug 27 00:52:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Port f4a1c5ef-9fa2-4b59-98a2-1b220f512442 binding to destination host user is already ACTIVE {{(pid=73458) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:52:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-72ffffb2-b5d1-43eb-a76f-b57a32536f86 req-b09c108b-712a-4118-9f6c-1d5d5859ec0c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-deleted-d566bacb-d803-4100-825b-e11a4179daf2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:49 user nova-compute[73458]: INFO nova.compute.manager [req-72ffffb2-b5d1-43eb-a76f-b57a32536f86 req-b09c108b-712a-4118-9f6c-1d5d5859ec0c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Neutron deleted interface d566bacb-d803-4100-825b-e11a4179daf2; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-72ffffb2-b5d1-43eb-a76f-b57a32536f86 req-b09c108b-712a-4118-9f6c-1d5d5859ec0c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "eeb32caf-3b94-4439-95c7-059a4b58184a", "address": "fa:16:3e:a6:1d:8c", "network": {"id": "f29a75af-bf0e-49fa-a8ec-10bdd92eaa19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-925202280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb32caf-3b", "ovs_interfaceid": "eeb32caf-3b94-4439-95c7-059a4b58184a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-72ffffb2-b5d1-43eb-a76f-b57a32536f86 req-b09c108b-712a-4118-9f6c-1d5d5859ec0c service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Detach interface failed, port_id=d566bacb-d803-4100-825b-e11a4179daf2, reason: Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.utils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d104af-3bf4-4f6a-932d-0bb456bed1e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db1316-65c6-4c99-b6ab-ded43c940b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ecab17-1e3c-466a-992b-f8257e93c3b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5369232a-1d57-4544-ab07-e3290a876cf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:52:49 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:52:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c8335-a469-458a-8ab1-8cad61921950]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:52:49 user nova-compute[73458]: DEBUG os_brick.utils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:50 user nova-compute[73458]: WARNING nova.compute.manager [req-833aa933-82c1-4de8-abac-6e466b0f296f req-93302636-550a-4f16-930d-b80dd197e0da service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state resize_finish.
Aug 27 00:52:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-deleted-eeb32caf-3b94-4439-95c7-059a4b58184a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:51 user nova-compute[73458]: INFO nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Neutron deleted interface eeb32caf-3b94-4439-95c7-059a4b58184a; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "address": "fa:16:3e:64:bb:4d", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1fa2b4f-da", "ovs_interfaceid": "b1fa2b4f-da94-416b-a093-731b3a8e404f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Detach interface failed, port_id=eeb32caf-3b94-4439-95c7-059a4b58184a, reason: Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-deleted-b1fa2b4f-da94-416b-a093-731b3a8e404f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:51 user nova-compute[73458]: INFO nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Neutron deleted interface b1fa2b4f-da94-416b-a093-731b3a8e404f; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "address": "fa:16:3e:b1:4c:05", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8d6a41a-f0", "ovs_interfaceid": "c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Detach interface failed, port_id=b1fa2b4f-da94-416b-a093-731b3a8e404f, reason: Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-deleted-c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:51 user nova-compute[73458]: INFO nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Neutron deleted interface c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa; detaching it from the instance and deleting it from the info cache
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [{"id": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "address": "fa:16:3e:c6:04:d9", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8273494a-e8", "ovs_interfaceid": "8273494a-e8c0-4f52-a7bf-1b44497c06fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "93581884-34c5-4660-8528-efde56489ce1", "address": "fa:16:3e:c3:d5:ef", "network": {"id": "1112e3e2-3382-4d44-b316-97b324e49c2f", "bridge": "br-int", "label": "tempest-device-tagging-net1-1337560631", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93581884-34", "ovs_interfaceid": "93581884-34c5-4660-8528-efde56489ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "address": "fa:16:3e:99:bd:89", "network": {"id": "fcd48fce-2dd7-4ac9-8753-7ec56fd9355e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1589177868", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "729dc2ba91944395b5210cb5ed43d1ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d102021-81", "ovs_interfaceid": "9d102021-81e6-4551-9db7-bd7e29adb1b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce89af80-f23c-4eb9-ae15-c5d1b0e7313c req-21bc0d04-d2a5-4743-9599-c24b881405f4 service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Detach interface failed, port_id=c8d6a41a-f0f5-4cac-a548-f8cc54ef24aa, reason: Instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:52:51 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:51 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Took 4.61 seconds to deallocate network for instance.
Aug 27 00:52:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Received event network-vif-deleted-9d102021-81e6-4551-9db7-bd7e29adb1b6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-changed-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing instance network info cache due to event network-changed-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] Acquiring lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] Acquired lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:53 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Refreshing network info cache for port f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:52:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updated VIF entry in instance network info cache for port f1d2df5a-cf3a-496f-98fc-1c97aa9684d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:52:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a2669d2-1add-49c8-84bb-24b7dd8ac663 req-531ab043-eb53-4787-936f-8114babeb58a service nova] Releasing lock "refresh_cache-3cc46c0f-ed32-4ad4-acea-c91399a3d883" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:52:56 user nova-compute[73458]: INFO nova.compute.claims [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Claim successful on node user
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:56 user nova-compute[73458]: INFO nova.compute.manager [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Terminating instance
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:52:56 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:52:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.policy [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64448af42ce44819a5ebc11f968d099e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc97d2501a284ec79d261c526265f32b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-a3acf739-98ed-4ace-8e51-1f28422a7b57 req-14b266a4-0ab7-4f65-93d9-3e25652a9193 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:52:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Creating image(s)
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.216s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk 1073741824" returned: 0 in 0.055s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-08eb45bc-772a-4e12-a1a1-6740fa242057 req-09fba1ac-6479-4bff-8750-0b267c3a3adb service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.232s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:52:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Cannot resize image /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Ensure instance console log exists: /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:58 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Instance destroyed successfully.
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lazy-loading 'resources' on Instance uuid 3cc46c0f-ed32-4ad4-acea-c91399a3d883 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1d2df5a-cf, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-9d309dfb-c823-4670-aeb9-b94e4f5f8999 req-59981d58-509f-427b-b92a-4b0e03d1c061 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:e4:15,bridge_name='br-int',has_traffic_filtering=True,id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5,network=Network(1e37580b-99ed-4ae1-ad78-9b1cc3767e46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1d2df5a-cf')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa924b9f-07, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:0b:15,bridge_name='br-int',has_traffic_filtering=True,id=fa924b9f-07af-41ed-ac93-d00ae2072e37,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa924b9f-07')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f6f8399-29, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b6:32,bridge_name='br-int',has_traffic_filtering=True,id=6f6f8399-2933-4ee4-86ba-8399e29648fb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f6f8399-29')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "address": "fa:16:3e:ca:5f:56", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcde54ab3-f7", "ovs_interfaceid": "cde54ab3-f79c-47ee-9ae6-a1170bd09a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcde54ab3-f7, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:5f:56,bridge_name='br-int',has_traffic_filtering=True,id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcde54ab3-f7')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a5fa9f3-af, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b2:1a,bridge_name='br-int',has_traffic_filtering=True,id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb,network=Network(4fb525fe-e29d-46d3-95a7-ca66b1e8ca45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5fa9f3-af')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d4efb28-7e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Successfully created port: 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:43:a6,bridge_name='br-int',has_traffic_filtering=True,id=0d4efb28-7efd-4ad3-a40f-328c99958fc2,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d4efb28-7e')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T00:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-433067106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-433067106',id=11,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRSvOn1JnnZyHYQRXFRxgbNUeMO4NFB5Leq1o3jAT6AKCPQrXsd5yhDnXBNqBlxj+dDXs1D6EjCMOWUcvi5tePbXRipLT1Qo/PV3/me/Y6p8F33MMZXjb3v4nhFPmVO2A==',key_name='tempest-keypair-1153423958',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ca8d63bdcdc4f14a74b584b42540437',ramdisk_id='',reservation_id='r-ou9z1ysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-475681524',owner_user_name='tempest-TaggedBootDevicesTest-475681524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:51:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc13d243d19e49c58823b958b76c20eb',uuid=3cc46c0f-ed32-4ad4-acea-c91399a3d883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converting VIF {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap163386e1-69, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:58 user nova-compute[73458]: INFO os_vif [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d9:99,bridge_name='br-int',has_traffic_filtering=True,id=163386e1-69f4-4959-8de8-ccfa7372d4c6,network=Network(b284ccd4-943e-4785-aab0-f4f15ce06092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163386e1-69')
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVcmzqgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:58 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e29f31-5721-4c47-96f2-ba4b44baca28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d9fe9-e5b3-45d6-a138-ba8af93510a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9031d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522'): ({'sdi'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Removing single pathed devices sdi {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d465b-6d72-40ed-80b2-1d607ad3f296]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ecd2a-612e-42c4-8c88-27ef3b0e9269]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Flushing IO for device /dev/sdi {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d04d8cc-3839-4c83-9ce5-fead336c1107]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425b60c-2e28-4a80-9d09-6667ef303dd7]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] SCSI volumes sdi have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[84035fd0-6cf7-487b-8450-2d2cd47c73f6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a94c5d-e786-4e44-93cc-2767a31cf0c9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260]
Aug 27 00:52:58 user nova-compute[73458]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a85f40b-c0ce-435e-adbd-64be614ba522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ff1e4-e920-441a-982d-34ecc1baeafd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== disconnect_volume: return (321ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HfgDjSvO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:58 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2370e2-62c9-4fe0-a31d-f92708f75ddd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a9f24-44d7-4bd2-b206-07dde0a997e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9031d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005'): ({'sdk'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Removing single pathed devices sdk {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b764526-4143-4cf8-adf1-55120cdb9f16]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b4ba5-19c0-4812-87e8-6852945a0eee]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Flushing IO for device /dev/sdk {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8392cf39-3d10-4c6c-a0d5-fc20a84dad50]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9bd45d-0e0e-47a8-ae33-09eb17fc060b]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] SCSI volumes sdk have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8513e6c-8192-4613-8142-049cc6e70ee6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:59 user nova-compute[73458]: WARNING nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 for instance with vm_state active and task_state deleting.
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:59 user nova-compute[73458]: WARNING nova.compute.manager [req-155360f4-9c4c-45d6-b46d-6ff2eb9e0508 req-ac532e4b-55d1-45d5-a1ef-77106615ee61 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-163386e1-69f4-4959-8de8-ccfa7372d4c6 for instance with vm_state active and task_state deleting.
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e248b-41d6-4bf3-a403-f79ce92733c9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260]
Aug 27 00:52:59 user nova-compute[73458]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da34ba64-594b-47c8-8586-89c26a364005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c658251d-c7c8-45b8-a9a6-ac77cfe77b11]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== disconnect_volume: return (326ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxCyzVju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:52:59 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8227ef9f-4d9d-4843-818c-46164895ec7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[204848ee-a121-4bb7-a002-d9002c616a08]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:59 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 (non-flash)
Aug 27 00:52:59 user nova-compute[73458]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:52:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78519bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60'): ({'sdg'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Removing single pathed devices sdg {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8dba4d-bb53-4791-a379-dd4c47ce2560]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Successfully updated port: 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[773ffe93-5029-48e8-a1ac-e41909fe44bd]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Flushing IO for device /dev/sdg {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93728b56-1954-4b70-944a-3f1ed80d5237]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e0c00-3ecb-4106-af61-a8dc4a04d3bf]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39193a-9a34-4400-b365-8504687a1481]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.139s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27574c-9a87-4f24-9406-a5d7418623ef]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260]
Aug 27 00:52:59 user nova-compute[73458]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60, portal: 172.16.0.220,3260] successful.
Aug 27 00:52:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c1d4e1-22ed-4297-a662-35307fdedb60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[547b179d-e9c3-4247-8698-7d6653cc5140]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] <== disconnect_volume: return (412ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:52:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Deleting instance files /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883_del
Aug 27 00:52:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Deletion of /opt/stack/data/nova/instances/3cc46c0f-ed32-4ad4-acea-c91399a3d883_del complete
Aug 27 00:52:59 user nova-compute[73458]: INFO nova.compute.manager [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Took 3.33 seconds to destroy the instance on the hypervisor.
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:52:59 user nova-compute[73458]: WARNING nova.compute.manager [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb for instance with vm_state active and task_state deleting.
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing instance network info cache due to event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance network_info: |[{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.neutron [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start _get_guest_xml network_info=[{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:52:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1962945541',display_name='tempest-ServerStableDeviceRescueTest-server-1962945541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1962945541',id=14,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgIu1wx5QmNGPoFJWle5oXsGIeKQQNYuSUKqf2HpCBce87wL/1qbGhHE/sHseHDQ1imPghaGIGNUpXpn45hRPDv1vZLB3iiCgcx29QKYy1SwgcVT6KOPoEJFr2cKAUcpg==',key_name='tempest-keypair-1397530717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc97d2501a284ec79d261c526265f32b',ramdisk_id='',reservation_id='r-2djw89le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-270201702',owner_user_name='tempest-ServerStableDeviceRescueTest-270201702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64448af42ce44819a5ebc11f968d099e',uuid=f4f1df39-5fd2-4ede-a842-490239d576fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converting VIF {"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097564.861631, eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:52:59 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] VM Stopped (Lifecycle Event)
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:52:59 user nova-compute[73458]:   <uuid>f4f1df39-5fd2-4ede-a842-490239d576fb</uuid>
Aug 27 00:52:59 user nova-compute[73458]:   <name>instance-0000000e</name>
Aug 27 00:52:59 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:52:59 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:52:59 user nova-compute[73458]:   <metadata>
Aug 27 00:52:59 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:52:59 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1962945541</nova:name>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:52:59</nova:creationTime>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:52:59 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:52:59 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:owner>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:user uuid="64448af42ce44819a5ebc11f968d099e">tempest-ServerStableDeviceRescueTest-270201702-project-member</nova:user>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:project uuid="bc97d2501a284ec79d261c526265f32b">tempest-ServerStableDeviceRescueTest-270201702</nova:project>
Aug 27 00:52:59 user nova-compute[73458]:       </nova:owner>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:52:59 user nova-compute[73458]:       <nova:ports>
Aug 27 00:52:59 user nova-compute[73458]:         <nova:port uuid="59fe0e5c-9ae7-445b-b379-fbf924be540d">
Aug 27 00:52:59 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:52:59 user nova-compute[73458]:         </nova:port>
Aug 27 00:52:59 user nova-compute[73458]:       </nova:ports>
Aug 27 00:52:59 user nova-compute[73458]:     </nova:instance>
Aug 27 00:52:59 user nova-compute[73458]:   </metadata>
Aug 27 00:52:59 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:52:59 user nova-compute[73458]:     <system>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="serial">f4f1df39-5fd2-4ede-a842-490239d576fb</entry>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="uuid">f4f1df39-5fd2-4ede-a842-490239d576fb</entry>
Aug 27 00:52:59 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:52:59 user nova-compute[73458]:     </system>
Aug 27 00:52:59 user nova-compute[73458]:   </sysinfo>
Aug 27 00:52:59 user nova-compute[73458]:   <os>
Aug 27 00:52:59 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:52:59 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:52:59 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:52:59 user nova-compute[73458]:   </os>
Aug 27 00:52:59 user nova-compute[73458]:   <features>
Aug 27 00:52:59 user nova-compute[73458]:     <acpi/>
Aug 27 00:52:59 user nova-compute[73458]:     <apic/>
Aug 27 00:52:59 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:52:59 user nova-compute[73458]:   </features>
Aug 27 00:52:59 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:52:59 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:52:59 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:52:59 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:52:59 user nova-compute[73458]:   </clock>
Aug 27 00:52:59 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:52:59 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:52:59 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:52:59 user nova-compute[73458]:   </cpu>
Aug 27 00:52:59 user nova-compute[73458]:   <devices>
Aug 27 00:52:59 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:52:59 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:52:59 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk"/>
Aug 27 00:52:59 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:52:59 user nova-compute[73458]:     </disk>
Aug 27 00:52:59 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:52:59 user nova-compute[73458]:       <mac address="fa:16:3e:d8:e5:bd"/>
Aug 27 00:52:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:59 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:52:59 user nova-compute[73458]:       <target dev="tap59fe0e5c-9a"/>
Aug 27 00:52:59 user nova-compute[73458]:     </interface>
Aug 27 00:52:59 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:52:59 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/console.log" append="off"/>
Aug 27 00:52:59 user nova-compute[73458]:     </serial>
Aug 27 00:52:59 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:52:59 user nova-compute[73458]:     <video>
Aug 27 00:52:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:52:59 user nova-compute[73458]:     </video>
Aug 27 00:52:59 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:52:59 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:52:59 user nova-compute[73458]:     </rng>
Aug 27 00:52:59 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:52:59 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:52:59 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:52:59 user nova-compute[73458]:     </memballoon>
Aug 27 00:52:59 user nova-compute[73458]:   </devices>
Aug 27 00:52:59 user nova-compute[73458]: </domain>
Aug 27 00:52:59 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1962945541',display_name='tempest-ServerStableDeviceRescueTest-server-1962945541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1962945541',id=14,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgIu1wx5QmNGPoFJWle5oXsGIeKQQNYuSUKqf2HpCBce87wL/1qbGhHE/sHseHDQ1imPghaGIGNUpXpn45hRPDv1vZLB3iiCgcx29QKYy1SwgcVT6KOPoEJFr2cKAUcpg==',key_name='tempest-keypair-1397530717',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc97d2501a284ec79d261c526265f32b',ramdisk_id='',reservation_id='r-2djw89le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-270201702',owner_user_name='tempest-ServerStableDeviceRescueTest-270201702-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64448af42ce44819a5ebc11f968d099e',uuid=f4f1df39-5fd2-4ede-a842-490239d576fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converting VIF {"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG os_vif [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59fe0e5c-9a, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59fe0e5c-9a, col_values=(('external_ids', {'iface-id': '59fe0e5c-9ae7-445b-b379-fbf924be540d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:e5:bd', 'vm-uuid': 'f4f1df39-5fd2-4ede-a842-490239d576fb'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0a4db405-b5a2-465a-b3ec-b8a4153f6ef5 None None] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:52:59 user nova-compute[73458]: INFO os_vif [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a')
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:52:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No VIF found with MAC fa:16:3e:d8:e5:bd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: WARNING nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 for instance with vm_state active and task_state deleting.
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: WARNING nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-fa924b9f-07af-41ed-ac93-d00ae2072e37 for instance with vm_state active and task_state deleting.
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-6f6f8399-2933-4ee4-86ba-8399e29648fb for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: WARNING nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-6f6f8399-2933-4ee4-86ba-8399e29648fb for instance with vm_state active and task_state deleting.
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-unplugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-79693335-ae72-40c3-906a-944356ceb2b8 req-c2f57816-e8ad-46bb-9b2a-e91f5d223f0e service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-unplugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated VIF entry in instance network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-339e10bd-b095-4fb8-a56c-ed89d849b1a1 req-3e5c098f-bb42-4505-af16-caaac313a699 service nova] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097565.717062, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:00 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Stopped (Lifecycle Event)
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-98800f32-3cdc-4491-87dd-606c241d2689 None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-98800f32-3cdc-4491-87dd-606c241d2689 None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:00 user nova-compute[73458]: INFO nova.compute.manager [None req-98800f32-3cdc-4491-87dd-606c241d2689 None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 00:53:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-8a21beca-046a-4f69-af09-1d53ba239fba req-eb688e2d-e840-4b15-bdf1-caebbb43b255 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-deleted-cde54ab3-f79c-47ee-9ae6-a1170bd09a86 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:01 user nova-compute[73458]: INFO nova.compute.manager [req-8a21beca-046a-4f69-af09-1d53ba239fba req-eb688e2d-e840-4b15-bdf1-caebbb43b255 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Neutron deleted interface cde54ab3-f79c-47ee-9ae6-a1170bd09a86; detaching it from the instance and deleting it from the info cache
Aug 27 00:53:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-8a21beca-046a-4f69-af09-1d53ba239fba req-eb688e2d-e840-4b15-bdf1-caebbb43b255 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "address": "fa:16:3e:e2:e4:15", "network": {"id": "1e37580b-99ed-4ae1-ad78-9b1cc3767e46", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-62110687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1d2df5a-cf", "ovs_interfaceid": "f1d2df5a-cf3a-496f-98fc-1c97aa9684d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-8a21beca-046a-4f69-af09-1d53ba239fba req-eb688e2d-e840-4b15-bdf1-caebbb43b255 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Detach interface failed, port_id=cde54ab3-f79c-47ee-9ae6-a1170bd09a86, reason: Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Acquiring lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] No waiting events found dispatching network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:02 user nova-compute[73458]: WARNING nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received unexpected event network-vif-plugged-0d4efb28-7efd-4ad3-a40f-328c99958fc2 for instance with vm_state active and task_state deleting.
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:02 user nova-compute[73458]: WARNING nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state building and task_state spawning.
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:02 user nova-compute[73458]: WARNING nova.compute.manager [req-16919976-6a77-4ebc-aeeb-acd75d966809 req-cfa21145-300f-420a-b7db-7efc21089fa3 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state building and task_state spawning.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097583.5955086, f4f1df39-5fd2-4ede-a842-490239d576fb => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Resumed (Lifecycle Event)
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance spawned successfully.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097583.5968738, f4f1df39-5fd2-4ede-a842-490239d576fb => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Started (Lifecycle Event)
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-deleted-f1d2df5a-cf3a-496f-98fc-1c97aa9684d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Neutron deleted interface f1d2df5a-cf3a-496f-98fc-1c97aa9684d5; detaching it from the instance and deleting it from the info cache
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "address": "fa:16:3e:53:b2:1a", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5fa9f3-af", "ovs_interfaceid": "3a5fa9f3-affe-4868-af41-e0c1e30a2fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Took 7.69 seconds to build instance.
Aug 27 00:53:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-07f0d744-b158-4875-bb26-481c762b0aaa tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.845s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Detach interface failed, port_id=f1d2df5a-cf3a-496f-98fc-1c97aa9684d5, reason: Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-deleted-3a5fa9f3-affe-4868-af41-e0c1e30a2fcb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:03 user nova-compute[73458]: INFO nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Neutron deleted interface 3a5fa9f3-affe-4868-af41-e0c1e30a2fcb; detaching it from the instance and deleting it from the info cache
Aug 27 00:53:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "address": "fa:16:3e:8b:43:a6", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d4efb28-7e", "ovs_interfaceid": "0d4efb28-7efd-4ad3-a40f-328c99958fc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Detach interface failed, port_id=3a5fa9f3-affe-4868-af41-e0c1e30a2fcb, reason: Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:53:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-deleted-0d4efb28-7efd-4ad3-a40f-328c99958fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:04 user nova-compute[73458]: INFO nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Neutron deleted interface 0d4efb28-7efd-4ad3-a40f-328c99958fc2; detaching it from the instance and deleting it from the info cache
Aug 27 00:53:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [{"id": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "address": "fa:16:3e:77:0b:15", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa924b9f-07", "ovs_interfaceid": "fa924b9f-07af-41ed-ac93-d00ae2072e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "address": "fa:16:3e:20:b6:32", "network": {"id": "4fb525fe-e29d-46d3-95a7-ca66b1e8ca45", "bridge": "br-int", "label": "tempest-device-tagging-net1-808769434", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f6f8399-29", "ovs_interfaceid": "6f6f8399-2933-4ee4-86ba-8399e29648fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "address": "fa:16:3e:22:d9:99", "network": {"id": "b284ccd4-943e-4785-aab0-f4f15ce06092", "bridge": "br-int", "label": "tempest-device-tagging-net2-1793995990", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7ca8d63bdcdc4f14a74b584b42540437", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163386e1-69", "ovs_interfaceid": "163386e1-69f4-4959-8de8-ccfa7372d4c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-23b7dda9-0ec6-43ba-8434-c464cf1f11a3 req-70db144c-bbca-4be8-83cc-0c1809e673fd service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Detach interface failed, port_id=0d4efb28-7efd-4ad3-a40f-328c99958fc2, reason: Instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:53:04 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:04 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Took 4.47 seconds to deallocate network for instance.
Aug 27 00:53:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-850f04bf-2759-40c2-8aa0-9ecf325ffe3d req-dcce8acb-d0d4-4239-81c4-784583ba5362 service nova] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Received event network-vif-deleted-163386e1-69f4-4959-8de8-ccfa7372d4c6 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Starting finish_migration {{(pid=73458) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 00:53:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Creating image(s)
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.253s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Checking if we can resize image /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk. size=21474836480 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk 21474836480 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk 21474836480" returned: 0 in 0.058s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Ensure instance console log exists: /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start _get_guest_xml network_info=[{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '014595b9-5cb2-4a12-a96c-b57ee091c8ed', 'attached_at': '2023-08-27T00:53:06.000000', 'detached_at': '', 'volume_id': '3e6cde00-d755-4505-950f-29c7eff8f633', 'serial': '3e6cde00-d755-4505-950f-29c7eff8f633'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '2bf9d89c-0d65-4e57-8b68-abc6a285837b', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:53:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:53:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:53:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:53:07 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4947c4-6f4e-4d0c-8aa9-ebfc0f472c34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:53:07 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e025a5f-546d-4025-9ace-e361562fa5ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d400ff-d4ab-4ef0-8452-5c3bf66c5a82]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc4361-1719-4cd9-8803-8d5e6cdd2d2e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814baff-4677-4813-9532-b08dae1b8488]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heVmybSO'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e84ad72-d584-4cb6-806a-d4a24254df5e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ec9569-bdfa-4e15-94cb-e2b2a11fa2f2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9996ed-4cd7-43d6-98b0-6c0b5bfe2e75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:53:07 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f182d01e-946a-4fb4-a729-d840f6f219dd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde8a71-e659-403e-83a2-47d7bfe1e537]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cddd812-15fd-4331-ba79-2239cc95692a]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:53:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:53:08 user nova-compute[73458]:   <uuid>014595b9-5cb2-4a12-a96c-b57ee091c8ed</uuid>
Aug 27 00:53:08 user nova-compute[73458]:   <name>instance-00000003</name>
Aug 27 00:53:08 user nova-compute[73458]:   <memory>2097152</memory>
Aug 27 00:53:08 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:53:08 user nova-compute[73458]:   <metadata>
Aug 27 00:53:08 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:53:08 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherB-server-193534920</nova:name>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:53:07</nova:creationTime>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:flavor name="m1.small">
Aug 27 00:53:08 user nova-compute[73458]:         <nova:memory>2048</nova:memory>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:disk>20</nova:disk>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:53:08 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:owner>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:user uuid="01ccff6ef49a4362a6576ccf9cbbf552">tempest-ServerActionsTestOtherB-1527688410-project-member</nova:user>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:project uuid="580bff8187b74188bf3d77bb1413ba5d">tempest-ServerActionsTestOtherB-1527688410</nova:project>
Aug 27 00:53:08 user nova-compute[73458]:       </nova:owner>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:53:08 user nova-compute[73458]:       <nova:ports>
Aug 27 00:53:08 user nova-compute[73458]:         <nova:port uuid="f4a1c5ef-9fa2-4b59-98a2-1b220f512442">
Aug 27 00:53:08 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:53:08 user nova-compute[73458]:         </nova:port>
Aug 27 00:53:08 user nova-compute[73458]:       </nova:ports>
Aug 27 00:53:08 user nova-compute[73458]:     </nova:instance>
Aug 27 00:53:08 user nova-compute[73458]:   </metadata>
Aug 27 00:53:08 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:53:08 user nova-compute[73458]:     <system>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="serial">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="uuid">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:53:08 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:53:08 user nova-compute[73458]:     </system>
Aug 27 00:53:08 user nova-compute[73458]:   </sysinfo>
Aug 27 00:53:08 user nova-compute[73458]:   <os>
Aug 27 00:53:08 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:53:08 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:53:08 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:53:08 user nova-compute[73458]:   </os>
Aug 27 00:53:08 user nova-compute[73458]:   <features>
Aug 27 00:53:08 user nova-compute[73458]:     <acpi/>
Aug 27 00:53:08 user nova-compute[73458]:     <apic/>
Aug 27 00:53:08 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:53:08 user nova-compute[73458]:   </features>
Aug 27 00:53:08 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:53:08 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:53:08 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:53:08 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:53:08 user nova-compute[73458]:   </clock>
Aug 27 00:53:08 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:53:08 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:53:08 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:53:08 user nova-compute[73458]:   </cpu>
Aug 27 00:53:08 user nova-compute[73458]:   <devices>
Aug 27 00:53:08 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:53:08 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:53:08 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk"/>
Aug 27 00:53:08 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:53:08 user nova-compute[73458]:     </disk>
Aug 27 00:53:08 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:53:08 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:53:08 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 00:53:08 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:53:08 user nova-compute[73458]:       <serial>3e6cde00-d755-4505-950f-29c7eff8f633</serial>
Aug 27 00:53:08 user nova-compute[73458]:     </disk>
Aug 27 00:53:08 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:53:08 user nova-compute[73458]:       <mac address="fa:16:3e:e4:e1:1e"/>
Aug 27 00:53:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:08 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:53:08 user nova-compute[73458]:       <target dev="tapf4a1c5ef-9f"/>
Aug 27 00:53:08 user nova-compute[73458]:     </interface>
Aug 27 00:53:08 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:53:08 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/console.log" append="off"/>
Aug 27 00:53:08 user nova-compute[73458]:     </serial>
Aug 27 00:53:08 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:53:08 user nova-compute[73458]:     <video>
Aug 27 00:53:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:08 user nova-compute[73458]:     </video>
Aug 27 00:53:08 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:53:08 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:53:08 user nova-compute[73458]:     </rng>
Aug 27 00:53:08 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:53:08 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:53:08 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:53:08 user nova-compute[73458]:     </memballoon>
Aug 27 00:53:08 user nova-compute[73458]:   </devices>
Aug 27 00:53:08 user nova-compute[73458]: </domain>
Aug 27 00:53:08 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1312501360-network", "vif_mac": "fa:16:3e:e4:e1:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG os_vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a1c5ef-9f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4a1c5ef-9f, col_values=(('external_ids', {'iface-id': 'f4a1c5ef-9fa2-4b59-98a2-1b220f512442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:e1:1e', 'vm-uuid': '014595b9-5cb2-4a12-a96c-b57ee091c8ed'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:08 user nova-compute[73458]: INFO os_vif [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:53:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] No VIF found with MAC fa:16:3e:e4:e1:1e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:53:08 user nova-compute[73458]: INFO nova.compute.manager [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] [instance: eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f] Took 17.28 seconds to detach 3 volumes for instance.
Aug 27 00:53:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:09 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:09 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:09 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Deleted allocations for instance eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f
Aug 27 00:53:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-86560f27-8e40-49a3-8604-68ec9ccfba84 tempest-TaggedBootDevicesTest_v242-354487124 tempest-TaggedBootDevicesTest_v242-354487124-project-member] Lock "eba8225e-69d1-4cc5-a34b-ff7c5ac4bc1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.673s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:10 user nova-compute[73458]: INFO nova.compute.manager [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Took 6.34 seconds to detach 3 volumes for instance.
Aug 27 00:53:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:10 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Deleted allocations for instance 3cc46c0f-ed32-4ad4-acea-c91399a3d883
Aug 27 00:53:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3ae914a3-0bd3-451b-8709-4d6842fddad4 tempest-TaggedBootDevicesTest-475681524 tempest-TaggedBootDevicesTest-475681524-project-member] Lock "3cc46c0f-ed32-4ad4-acea-c91399a3d883" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.764s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:11 user nova-compute[73458]: WARNING nova.compute.manager [req-ce154ecc-f763-45bc-a176-7f40d3f24a95 req-2cf50ab3-fe82-4a1f-9745-08bd28c7a29a service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state resize_finish.
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097592.8363152, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Resumed (Lifecycle Event)
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:53:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance running successfully.
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Failed to set time: agent not configured {{(pid=73458) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0c95ce8a-70e9-4211-a074-27a55cb5ec51 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] finish_migration finished successfully. {{(pid=73458) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097592.8511527, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Started (Lifecycle Event)
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 00:53:13 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097578.0947602, 3cc46c0f-ed32-4ad4-acea-c91399a3d883 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:13 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] VM Stopped (Lifecycle Event)
Aug 27 00:53:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-626e648d-95c8-4928-bb53-e8ddeca4783c None None] [instance: 3cc46c0f-ed32-4ad4-acea-c91399a3d883] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:13 user nova-compute[73458]: WARNING nova.compute.manager [req-43e40553-311d-4e6d-95e0-216eab3b1684 req-4b759db2-5ae6-4870-badc-f591f4d55f42 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state resized and task_state None.
Aug 27 00:53:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:53:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:21 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:21 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:21 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7813MB free_disk=25.789112091064453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:21 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Applying migration context for instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed as it has an incoming, in-progress migration cc11fdd5-a118-433d-ab59-6ae612211627. Migration status is finished {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 00:53:21 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating resource usage from migration cc11fdd5-a118-433d-ab59-6ae612211627
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c709b541-1fa2-406e-9210-fbfd4ac870ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Migration cc11fdd5-a118-433d-ab59-6ae612211627 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:53:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:23 user nova-compute[73458]: INFO nova.compute.manager [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Terminating instance
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Skipping network cache update for instance because it is being deleted. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9f140de9-a7eb-4041-a79f-241a9f85b35b {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-unplugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] No waiting events found dispatching network-vif-unplugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-8872fdd1-d0b4-4aac-acab-74f3e342e664 req-3c41c798-5d51-44d6-ad5b-b7c42aa945d1 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-unplugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Instance destroyed successfully.
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lazy-loading 'resources' on Instance uuid c709b541-1fa2-406e-9210-fbfd4ac870ac {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:49:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1522433354',display_name='tempest-TestVolumeSwap-server-1522433354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1522433354',id=7,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIPocWd43So4hjJPMiXLu4YYtO2Ufi601pq64gMQUkpzwCcxAosTIvTdo3Wd7LoYdrish/M0FNp8b3tmdS6f+yNOqICDGhOh4eXxnyKy4Zw0dmCj791nuMXH9rMlpUfVw==',key_name='tempest-keypair-1888365244',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac76c536b5304a01a3b3af02127b20b1',ramdisk_id='',reservation_id='r-7nz82do2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-724115542',owner_user_name='tempest-TestVolumeSwap-724115542-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9ec112c9cf94ecea071b1db01a3d811',uuid=c709b541-1fa2-406e-9210-fbfd4ac870ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converting VIF {"id": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "address": "fa:16:3e:79:9d:83", "network": {"id": "d4b64c1f-00f6-4fa8-91e3-17e6158d70a2", "bridge": "br-int", "label": "tempest-TestVolumeSwap-528517012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac76c536b5304a01a3b3af02127b20b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2076d0b7-1b", "ovs_interfaceid": "2076d0b7-1bdf-4797-8f8e-da4ab2c9a653", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG os_vif [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2076d0b7-1b, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:23 user nova-compute[73458]: INFO os_vif [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:9d:83,bridge_name='br-int',has_traffic_filtering=True,id=2076d0b7-1bdf-4797-8f8e-da4ab2c9a653,network=Network(d4b64c1f-00f6-4fa8-91e3-17e6158d70a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2076d0b7-1b')
Aug 27 00:53:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Deleting instance files /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac_del
Aug 27 00:53:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Deletion of /opt/stack/data/nova/instances/c709b541-1fa2-406e-9210-fbfd4ac870ac_del complete
Aug 27 00:53:24 user nova-compute[73458]: INFO nova.compute.manager [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 00:53:24 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [{"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9f140de9-a7eb-4041-a79f-241a9f85b35b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] Acquiring lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] No waiting events found dispatching network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:25 user nova-compute[73458]: WARNING nova.compute.manager [req-ffa32eac-91f4-4bcd-b057-ff04f722ccfd req-ecd6b934-c18f-472b-97ad-3e2a3d07f67e service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received unexpected event network-vif-plugged-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 for instance with vm_state active and task_state deleting.
Aug 27 00:53:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:26 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Took 2.27 seconds to deallocate network for instance.
Aug 27 00:53:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-6583d2a5-8080-4c31-b927-d19230f7a0ef req-2a2aae94-7b95-40b4-9076-b1af93696183 service nova] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Received event network-vif-deleted-2076d0b7-1bdf-4797-8f8e-da4ab2c9a653 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:26 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Deleted allocations for instance c709b541-1fa2-406e-9210-fbfd4ac870ac
Aug 27 00:53:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5ac6a025-e17a-44fe-89b6-638fd2c919c7 tempest-TestVolumeSwap-724115542 tempest-TestVolumeSwap-724115542-project-member] Lock "c709b541-1fa2-406e-9210-fbfd4ac870ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.749s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:53:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:38 user nova-compute[73458]: INFO nova.compute.manager [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Unshelving
Aug 27 00:53:38 user nova-compute[73458]: INFO nova.virt.block_device [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Booting with volume ca9a6eb3-46e5-48fc-99ea-976b63e477aa at /dev/vda
Aug 27 00:53:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:38 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097603.93434, c709b541-1fa2-406e-9210-fbfd4ac870ac => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:38 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] VM Stopped (Lifecycle Event)
Aug 27 00:53:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-23816017-f1ad-474a-956c-54184860dd70 None None] [instance: c709b541-1fa2-406e-9210-fbfd4ac870ac] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.utils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5552ade2-a969-4134-97b6-8198567f7403]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46b88be-1b42-4733-8bd5-89818d83b4c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d72df-f067-435d-b163-719abe36ccd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd6a213-53df-40ce-8386-81c3328ff040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:53:39 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:53:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba4fa73-0411-4de1-9b42-8f9982dc2aff]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG os_brick.utils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating existing volume attachment record: e5805598-fca7-42e2-a716-6a3568191629 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:53:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:53:43 user nova-compute[73458]: INFO nova.compute.claims [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Claim successful on node user
Aug 27 00:53:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:53:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.policy [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a452f9412de4c8d881d30b02c01d3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3537b33489d84282958ddf05f58ade1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:53:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Creating image(s)
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "/opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk 1073741824" returned: 0 in 0.046s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Successfully created port: 42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Cannot resize image /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Ensure instance console log exists: /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Successfully updated port: 42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:53:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:53:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-changed-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Refreshing instance network info cache due to event network-changed-42d2ba39-30e8-4a52-95e8-d83183cc6c18. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] Acquiring lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updating instance_info_cache with network_info: [{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Instance network_info: |[{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] Acquired lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Refreshing network info cache for port 42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Start _get_guest_xml network_info=[{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:53:46 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:46 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-655930893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-655930893',id=15,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-9jhm8sfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:53:44Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=2317c1cf-8971-489e-928f-93a3a0ddf2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 2317c1cf-8971-489e-928f-93a3a0ddf2b8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:53:46 user nova-compute[73458]:   <uuid>2317c1cf-8971-489e-928f-93a3a0ddf2b8</uuid>
Aug 27 00:53:46 user nova-compute[73458]:   <name>instance-0000000f</name>
Aug 27 00:53:46 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:53:46 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:53:46 user nova-compute[73458]:   <metadata>
Aug 27 00:53:46 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:53:46 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-655930893</nova:name>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:53:46</nova:creationTime>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:53:46 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:53:46 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:owner>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 00:53:46 user nova-compute[73458]:       </nova:owner>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:53:46 user nova-compute[73458]:       <nova:ports>
Aug 27 00:53:46 user nova-compute[73458]:         <nova:port uuid="42d2ba39-30e8-4a52-95e8-d83183cc6c18">
Aug 27 00:53:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 00:53:46 user nova-compute[73458]:         </nova:port>
Aug 27 00:53:46 user nova-compute[73458]:       </nova:ports>
Aug 27 00:53:46 user nova-compute[73458]:     </nova:instance>
Aug 27 00:53:46 user nova-compute[73458]:   </metadata>
Aug 27 00:53:46 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:53:46 user nova-compute[73458]:     <system>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="serial">2317c1cf-8971-489e-928f-93a3a0ddf2b8</entry>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="uuid">2317c1cf-8971-489e-928f-93a3a0ddf2b8</entry>
Aug 27 00:53:46 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:53:46 user nova-compute[73458]:     </system>
Aug 27 00:53:46 user nova-compute[73458]:   </sysinfo>
Aug 27 00:53:46 user nova-compute[73458]:   <os>
Aug 27 00:53:46 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:53:46 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:53:46 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:53:46 user nova-compute[73458]:   </os>
Aug 27 00:53:46 user nova-compute[73458]:   <features>
Aug 27 00:53:46 user nova-compute[73458]:     <acpi/>
Aug 27 00:53:46 user nova-compute[73458]:     <apic/>
Aug 27 00:53:46 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:53:46 user nova-compute[73458]:   </features>
Aug 27 00:53:46 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:53:46 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:53:46 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:53:46 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:53:46 user nova-compute[73458]:   </clock>
Aug 27 00:53:46 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:53:46 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:53:46 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:53:46 user nova-compute[73458]:   </cpu>
Aug 27 00:53:46 user nova-compute[73458]:   <devices>
Aug 27 00:53:46 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:53:46 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:53:46 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk"/>
Aug 27 00:53:46 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:53:46 user nova-compute[73458]:     </disk>
Aug 27 00:53:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:53:46 user nova-compute[73458]:       <mac address="fa:16:3e:b0:0d:7b"/>
Aug 27 00:53:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:53:46 user nova-compute[73458]:       <target dev="tap42d2ba39-30"/>
Aug 27 00:53:46 user nova-compute[73458]:     </interface>
Aug 27 00:53:46 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:53:46 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/console.log" append="off"/>
Aug 27 00:53:46 user nova-compute[73458]:     </serial>
Aug 27 00:53:46 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:53:46 user nova-compute[73458]:     <video>
Aug 27 00:53:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:46 user nova-compute[73458]:     </video>
Aug 27 00:53:46 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:53:46 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:53:46 user nova-compute[73458]:     </rng>
Aug 27 00:53:46 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:53:46 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:53:46 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:53:46 user nova-compute[73458]:     </memballoon>
Aug 27 00:53:46 user nova-compute[73458]:   </devices>
Aug 27 00:53:46 user nova-compute[73458]: </domain>
Aug 27 00:53:46 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-655930893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-655930893',id=15,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-9jhm8sfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:53:44Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=2317c1cf-8971-489e-928f-93a3a0ddf2b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG os_vif [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42d2ba39-30, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42d2ba39-30, col_values=(('external_ids', {'iface-id': '42d2ba39-30e8-4a52-95e8-d83183cc6c18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:0d:7b', 'vm-uuid': '2317c1cf-8971-489e-928f-93a3a0ddf2b8'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:46 user nova-compute[73458]: INFO os_vif [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30')
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:b0:0d:7b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updated VIF entry in instance network info cache for port 42d2ba39-30e8-4a52-95e8-d83183cc6c18. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updating instance_info_cache with network_info: [{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afc988b0-f428-4ebb-9e3d-d10b54ea1a92 req-29d69f9a-0565-4a6a-bfe1-53d7142e4241 service nova] Releasing lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097630.1364744, 2317c1cf-8971-489e-928f-93a3a0ddf2b8 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] VM Resumed (Lifecycle Event)
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Instance spawned successfully.
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097630.1412053, 2317c1cf-8971-489e-928f-93a3a0ddf2b8 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] VM Started (Lifecycle Event)
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:50 user nova-compute[73458]: WARNING nova.compute.manager [req-3cc06c2b-e700-4f3c-8297-27c9e1d620d0 req-9f1b8c5e-aca1-4efd-8509-3cd583f82ed6 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state building and task_state spawning.
Aug 27 00:53:50 user nova-compute[73458]: INFO nova.compute.manager [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Took 7.24 seconds to build instance.
Aug 27 00:53:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-15a6bc8e-75f6-4f94-9b79-ceace72dc5e8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.332s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'pci_requests' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'numa_topology' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:53:52 user nova-compute[73458]: INFO nova.compute.claims [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Claim successful on node user
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:52 user nova-compute[73458]: WARNING nova.compute.manager [req-9f02ac08-36d3-4683-9969-49881a80bec4 req-3af434f6-475a-4340-868b-86090aea9fa2 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state active and task_state None.
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:52 user nova-compute[73458]: INFO nova.network.neutron [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating port cb535f02-3171-47c1-b52a-71ec0b82a909 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing instance network info cache due to event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:53:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:53:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Creating image(s)
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Ensure instance console log exists: /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start _get_guest_xml network_info=[{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca9a6eb3-46e5-48fc-99ea-976b63e477aa', 'serial': 'ca9a6eb3-46e5-48fc-99ea-976b63e477aa'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'e5805598-fca7-42e2-a716-6a3568191629', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:53:54 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:54 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.objects.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Object Instance<68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:53:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:53:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:53:54 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb427a0-93bd-48b4-b2c8-4cc88a5acb3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:53:54 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing instance network info cache due to event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7345b5-b2c8-46d8-8f0a-0dcd1cecd1c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa] added
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[032336d9-39fe-4a5d-b829-b30665c418d5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa0847-83ca-48b5-bb8e-4a912e8bd8fc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srvNaoiK {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srvNaoiK" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc694b4-9e38-4f6d-bbd8-04bbe1010d33]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srvNaoiK'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[30121a0f-7389-49a6-b1c7-303382350dbe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cea848-409a-455c-acbe-e1e307e88928]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b229b-2162-4212-bd8f-200e1e7519fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]
Aug 27 00:53:54 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d8d339-2cc4-4e71-8451-3590b1389b62]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[78689583-3f8a-4ac8-a78d-4febed25730f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:53:54 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:53:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90884640-b82e-4080-8d54-ad4f2bb03042]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updated VIF entry in instance network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d8945d4d-1850-4a87-bb2a-430b8d9ce317 req-4948d3fe-a2aa-443b-838b-40341585405f service nova] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated VIF entry in instance network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8a345f0-1f70-44f1-9970-96bfd69a9df6 req-922caac4-4185-4c20-8d8d-7fbc2414c7d7 service nova] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:53:55 user nova-compute[73458]: INFO nova.compute.claims [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Claim successful on node user
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:53:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.policy [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38cdf950732a4f6581779ce01d3eea2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a956bb1b3c495b8d65db34fb63349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:53:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Creating image(s)
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "/opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "/opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "/opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23030306137356331', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030306137356331', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1424313510',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:53:39Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.objects.base [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Object Instance<68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:53:55 user nova-compute[73458]:   <uuid>68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</uuid>
Aug 27 00:53:55 user nova-compute[73458]:   <name>instance-00000009</name>
Aug 27 00:53:55 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:53:55 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:53:55 user nova-compute[73458]:   <metadata>
Aug 27 00:53:55 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:53:55 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:53:55 user nova-compute[73458]:       <nova:name>tempest-TestShelveInstance-server-1612863848</nova:name>
Aug 27 00:53:55 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:53:54</nova:creationTime>
Aug 27 00:53:55 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:53:55 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:53:55 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:53:55 user nova-compute[73458]:       <nova:owner>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:user uuid="bcdf4d7863614457b38647daca7f705b">tempest-TestShelveInstance-1196851470-project-member</nova:user>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:project uuid="872acb80a3aa45cc904b6a0ecd846a24">tempest-TestShelveInstance-1196851470</nova:project>
Aug 27 00:53:55 user nova-compute[73458]:       </nova:owner>
Aug 27 00:53:55 user nova-compute[73458]:       <nova:ports>
Aug 27 00:53:55 user nova-compute[73458]:         <nova:port uuid="cb535f02-3171-47c1-b52a-71ec0b82a909">
Aug 27 00:53:55 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:53:55 user nova-compute[73458]:         </nova:port>
Aug 27 00:53:55 user nova-compute[73458]:       </nova:ports>
Aug 27 00:53:55 user nova-compute[73458]:     </nova:instance>
Aug 27 00:53:55 user nova-compute[73458]:   </metadata>
Aug 27 00:53:55 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:53:55 user nova-compute[73458]:     <system>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="serial">68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</entry>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="uuid">68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f</entry>
Aug 27 00:53:55 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:53:55 user nova-compute[73458]:     </system>
Aug 27 00:53:55 user nova-compute[73458]:   </sysinfo>
Aug 27 00:53:55 user nova-compute[73458]:   <os>
Aug 27 00:53:55 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:53:55 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:53:55 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:53:55 user nova-compute[73458]:   </os>
Aug 27 00:53:55 user nova-compute[73458]:   <features>
Aug 27 00:53:55 user nova-compute[73458]:     <acpi/>
Aug 27 00:53:55 user nova-compute[73458]:     <apic/>
Aug 27 00:53:55 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:53:55 user nova-compute[73458]:   </features>
Aug 27 00:53:55 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:53:55 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:53:55 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:53:55 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:53:55 user nova-compute[73458]:   </clock>
Aug 27 00:53:55 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:53:55 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:53:55 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:53:55 user nova-compute[73458]:   </cpu>
Aug 27 00:53:55 user nova-compute[73458]:   <devices>
Aug 27 00:53:55 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:53:55 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:53:55 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 00:53:55 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:53:55 user nova-compute[73458]:       <serial>ca9a6eb3-46e5-48fc-99ea-976b63e477aa</serial>
Aug 27 00:53:55 user nova-compute[73458]:     </disk>
Aug 27 00:53:55 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:53:55 user nova-compute[73458]:       <mac address="fa:16:3e:c1:1d:4c"/>
Aug 27 00:53:55 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:55 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:53:55 user nova-compute[73458]:       <target dev="tapcb535f02-31"/>
Aug 27 00:53:55 user nova-compute[73458]:     </interface>
Aug 27 00:53:55 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:53:55 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f/console.log" append="off"/>
Aug 27 00:53:55 user nova-compute[73458]:     </serial>
Aug 27 00:53:55 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:53:55 user nova-compute[73458]:     <video>
Aug 27 00:53:55 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:55 user nova-compute[73458]:     </video>
Aug 27 00:53:55 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:53:55 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:53:55 user nova-compute[73458]:     </rng>
Aug 27 00:53:55 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:53:55 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:53:55 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:53:55 user nova-compute[73458]:     </memballoon>
Aug 27 00:53:55 user nova-compute[73458]:   </devices>
Aug 27 00:53:55 user nova-compute[73458]: </domain>
Aug 27 00:53:55 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1424313510',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:53:39Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG os_vif [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb535f02-31, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb535f02-31, col_values=(('external_ids', {'iface-id': 'cb535f02-3171-47c1-b52a-71ec0b82a909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:1d:4c', 'vm-uuid': '68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:55 user nova-compute[73458]: INFO os_vif [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31')
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] No VIF found with MAC fa:16:3e:c1:1d:4c, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk 1073741824" returned: 0 in 0.048s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Successfully created port: c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Cannot resize image /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Ensure instance console log exists: /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Successfully updated port: c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquired lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-changed-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Refreshing instance network info cache due to event network-changed-c71ca2d8-85d2-4130-8f81-88cc241c9c66. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] Acquiring lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updating instance_info_cache with network_info: [{"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Releasing lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Instance network_info: |[{"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] Acquired lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Refreshing network info cache for port c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Start _get_guest_xml network_info=[{"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:53:58 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:58 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177357940',display_name='tempest-VolumesAdminNegativeTest-server-1177357940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177357940',id=16,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdoCl5QNNlvIEK8BiJRZR6U1a18sucHEDN/ygFxkL/H1J4Mjd9Xul0D0JbD4358doW8Fbjh3x8Z2AmSWMe6Nnp0e1RXwDMFeR4O3ydQZouAZepbTlUTCVP5TorEkOZW0Q==',key_name='tempest-keypair-384018075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-o7y0nxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=a800258d-520b-4e76-90b4-0f7b2c8f3adc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'pci_devices' on Instance uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:53:58 user nova-compute[73458]:   <uuid>a800258d-520b-4e76-90b4-0f7b2c8f3adc</uuid>
Aug 27 00:53:58 user nova-compute[73458]:   <name>instance-00000010</name>
Aug 27 00:53:58 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:53:58 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:53:58 user nova-compute[73458]:   <metadata>
Aug 27 00:53:58 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:53:58 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1177357940</nova:name>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:53:58</nova:creationTime>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:53:58 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:53:58 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:owner>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:user uuid="38cdf950732a4f6581779ce01d3eea2c">tempest-VolumesAdminNegativeTest-405879464-project-member</nova:user>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:project uuid="69a956bb1b3c495b8d65db34fb63349f">tempest-VolumesAdminNegativeTest-405879464</nova:project>
Aug 27 00:53:58 user nova-compute[73458]:       </nova:owner>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:53:58 user nova-compute[73458]:       <nova:ports>
Aug 27 00:53:58 user nova-compute[73458]:         <nova:port uuid="c71ca2d8-85d2-4130-8f81-88cc241c9c66">
Aug 27 00:53:58 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 00:53:58 user nova-compute[73458]:         </nova:port>
Aug 27 00:53:58 user nova-compute[73458]:       </nova:ports>
Aug 27 00:53:58 user nova-compute[73458]:     </nova:instance>
Aug 27 00:53:58 user nova-compute[73458]:   </metadata>
Aug 27 00:53:58 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:53:58 user nova-compute[73458]:     <system>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="serial">a800258d-520b-4e76-90b4-0f7b2c8f3adc</entry>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="uuid">a800258d-520b-4e76-90b4-0f7b2c8f3adc</entry>
Aug 27 00:53:58 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:53:58 user nova-compute[73458]:     </system>
Aug 27 00:53:58 user nova-compute[73458]:   </sysinfo>
Aug 27 00:53:58 user nova-compute[73458]:   <os>
Aug 27 00:53:58 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:53:58 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:53:58 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:53:58 user nova-compute[73458]:   </os>
Aug 27 00:53:58 user nova-compute[73458]:   <features>
Aug 27 00:53:58 user nova-compute[73458]:     <acpi/>
Aug 27 00:53:58 user nova-compute[73458]:     <apic/>
Aug 27 00:53:58 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:53:58 user nova-compute[73458]:   </features>
Aug 27 00:53:58 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:53:58 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:53:58 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:53:58 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:53:58 user nova-compute[73458]:   </clock>
Aug 27 00:53:58 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:53:58 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:53:58 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:53:58 user nova-compute[73458]:   </cpu>
Aug 27 00:53:58 user nova-compute[73458]:   <devices>
Aug 27 00:53:58 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:53:58 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:53:58 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk"/>
Aug 27 00:53:58 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:53:58 user nova-compute[73458]:     </disk>
Aug 27 00:53:58 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:53:58 user nova-compute[73458]:       <mac address="fa:16:3e:c6:bc:dd"/>
Aug 27 00:53:58 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:58 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:53:58 user nova-compute[73458]:       <target dev="tapc71ca2d8-85"/>
Aug 27 00:53:58 user nova-compute[73458]:     </interface>
Aug 27 00:53:58 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:53:58 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/console.log" append="off"/>
Aug 27 00:53:58 user nova-compute[73458]:     </serial>
Aug 27 00:53:58 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:53:58 user nova-compute[73458]:     <video>
Aug 27 00:53:58 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:53:58 user nova-compute[73458]:     </video>
Aug 27 00:53:58 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:53:58 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:53:58 user nova-compute[73458]:     </rng>
Aug 27 00:53:58 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:53:58 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:53:58 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:53:58 user nova-compute[73458]:     </memballoon>
Aug 27 00:53:58 user nova-compute[73458]:   </devices>
Aug 27 00:53:58 user nova-compute[73458]: </domain>
Aug 27 00:53:58 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177357940',display_name='tempest-VolumesAdminNegativeTest-server-1177357940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177357940',id=16,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdoCl5QNNlvIEK8BiJRZR6U1a18sucHEDN/ygFxkL/H1J4Mjd9Xul0D0JbD4358doW8Fbjh3x8Z2AmSWMe6Nnp0e1RXwDMFeR4O3ydQZouAZepbTlUTCVP5TorEkOZW0Q==',key_name='tempest-keypair-384018075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-o7y0nxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=a800258d-520b-4e76-90b4-0f7b2c8f3adc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG os_vif [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc71ca2d8-85, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc71ca2d8-85, col_values=(('external_ids', {'iface-id': 'c71ca2d8-85d2-4130-8f81-88cc241c9c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:bc:dd', 'vm-uuid': 'a800258d-520b-4e76-90b4-0f7b2c8f3adc'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: INFO os_vif [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85')
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No VIF found with MAC fa:16:3e:c6:bc:dd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updated VIF entry in instance network info cache for port c71ca2d8-85d2-4130-8f81-88cc241c9c66. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updating instance_info_cache with network_info: [{"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:53:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c9b8cbf-0117-4553-bd7c-2f5c1036c019 req-eac7d130-e6a2-4346-8fe6-255eb5eefe84 service nova] Releasing lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:59 user nova-compute[73458]: WARNING nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:53:59 user nova-compute[73458]: WARNING nova.compute.manager [req-57b778ec-2332-43c0-ad33-978634afe81b req-48142794-df1b-4212-a906-795d154bce7b service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 00:53:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097639.7908359, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Resumed (Lifecycle Event)
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance spawned successfully.
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097639.792999, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:53:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Started (Lifecycle Event)
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:53:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:53:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:53:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ba1ed4ec-3db1-4241-8794-e8b7bcb43ee4 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.151s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] No waiting events found dispatching network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:01 user nova-compute[73458]: WARNING nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received unexpected event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 for instance with vm_state building and task_state spawning.
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] No waiting events found dispatching network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:01 user nova-compute[73458]: WARNING nova.compute.manager [req-c3c2fcb5-a34c-4dec-a65f-d1b3d8175a67 req-e84bd372-f339-45e2-82cb-8469ea08e14d service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received unexpected event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 for instance with vm_state building and task_state spawning.
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097641.9713619, a800258d-520b-4e76-90b4-0f7b2c8f3adc => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] VM Resumed (Lifecycle Event)
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:54:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Instance spawned successfully.
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:54:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097641.9724932, a800258d-520b-4e76-90b4-0f7b2c8f3adc => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] VM Started (Lifecycle Event)
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:54:02 user nova-compute[73458]: INFO nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 27 00:54:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:02 user nova-compute[73458]: INFO nova.compute.manager [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Took 7.16 seconds to build instance.
Aug 27 00:54:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3390ebbc-fb83-4ace-8d98-e408397c7892 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.292s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:07 user nova-compute[73458]: INFO nova.compute.manager [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Terminating instance
Aug 27 00:54:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-36b1a59b-8285-4a86-b1c1-be723528961a req-5e006886-e0fe-4a71-8574-cf45391e279a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Instance destroyed successfully.
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lazy-loading 'resources' on Instance uuid 7492f540-2a69-463c-82f7-9ea78fc6c8a6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1402922038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394550917',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpSrcFOrgoGTJeEiZo3S6Aj2XmGskQv1zb/WTg4RD+p8HUBYTWuh1pFdC3T1RLYvmX5cRIJhRHOIbEZwR+uRQCYBWFNCKUBfg50kSmIH7R+oq5pEOH38aB0v+TP0gQJrg==',key_name='tempest-keypair-353011757',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7af9bf87985e40759127eaa701c05d67',ramdisk_id='',reservation_id='r-wiekuwc5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1142258299',owner_user_name='tempest-ServerActionsV293TestJSON-1142258299-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad6b59eaab96447e885ff14e644aaf5b',uuid=7492f540-2a69-463c-82f7-9ea78fc6c8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converting VIF {"id": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "address": "fa:16:3e:94:ee:16", "network": {"id": "dbc1d0ee-2931-4bfe-ae92-b6d55deadc65", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-974325562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af9bf87985e40759127eaa701c05d67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd38e00a5-60", "ovs_interfaceid": "d38e00a5-6077-4aa3-bfea-7897c6fa733a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_vif [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd38e00a5-60, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:54:08 user nova-compute[73458]: INFO os_vif [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:ee:16,bridge_name='br-int',has_traffic_filtering=True,id=d38e00a5-6077-4aa3-bfea-7897c6fa733a,network=Network(dbc1d0ee-2931-4bfe-ae92-b6d55deadc65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd38e00a5-60')
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQzdXYKu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:54:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9fe181-39c8-4d62-b4c2-c06e8c11440b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2aefa7-818e-4ef6-8d1c-e712b65ca295]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:54:08 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:08 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 (non-flash)
Aug 27 00:54:08 user nova-compute[73458]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:08 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eb02320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33db4a2-4918-4b79-972a-0e80275422e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.041s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf645f7-c592-427f-a7a3-8c6496954aa1]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f290d-5fbf-4b63-bdd6-d14f0d2ad128]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de9e21-7b99-4758-ba8c-fc1f045af9f4]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cf3382d8', '/dev/disk/by-id/scsi-1SCST_BIOcf3382d8-47706b14dba6deab', '/dev/disk/by-id/scsi-23437373036623134') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 00:54:08 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_cf3382d8
Aug 27 00:54:08 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOcf3382d8-47706b14dba6deab
Aug 27 00:54:08 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23437373036623134
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eaa272-d951-4954-89fd-4d44578c10d5]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f46ad1-b169-4021-84b0-8a58c03b1491]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c04061b-d125-484f-b9f4-59a5f29e9d5f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260]
Aug 27 00:54:08 user nova-compute[73458]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82, portal: 172.16.0.220,3260] successful.
Aug 27 00:54:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b153e901-0356-4a3b-964f-3f17ee111a82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b812ddf-28aa-4be6-aa73-b0d42f270ee1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] <== disconnect_volume: return (405ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:54:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deleting instance files /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6_del
Aug 27 00:54:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deletion of /opt/stack/data/nova/instances/7492f540-2a69-463c-82f7-9ea78fc6c8a6_del complete
Aug 27 00:54:08 user nova-compute[73458]: INFO nova.compute.manager [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 27 00:54:08 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:09 user nova-compute[73458]: WARNING nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state deleting.
Aug 27 00:54:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:09 user nova-compute[73458]: WARNING nova.compute.manager [req-80fa09bb-e743-49bc-b4ff-57db6d80e83c req-54e719cb-4d44-4954-a638-babf2bfa5a0a service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state deleting.
Aug 27 00:54:10 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:10 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Took 1.93 seconds to deallocate network for instance.
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:11 user nova-compute[73458]: WARNING nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state deleting.
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-unplugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Acquiring lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] No waiting events found dispatching network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:11 user nova-compute[73458]: WARNING nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received unexpected event network-vif-plugged-d38e00a5-6077-4aa3-bfea-7897c6fa733a for instance with vm_state active and task_state deleting.
Aug 27 00:54:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-242d1ce9-6bdc-4347-b900-c7f95eee8707 req-8dd36ee2-9bad-458d-9fca-7556bcaf2b58 service nova] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Received event network-vif-deleted-d38e00a5-6077-4aa3-bfea-7897c6fa733a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:54:17 user nova-compute[73458]: INFO nova.compute.manager [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Took 7.17 seconds to detach 1 volumes for instance.
Aug 27 00:54:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Deleting volume: b153e901-0356-4a3b-964f-3f17ee111a82 {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 00:54:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:18 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Deleted allocations for instance 7492f540-2a69-463c-82f7-9ea78fc6c8a6
Aug 27 00:54:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9cda0c35-e640-46d7-a901-6f576f98587f tempest-ServerActionsV293TestJSON-1142258299 tempest-ServerActionsV293TestJSON-1142258299-project-member] Lock "7492f540-2a69-463c-82f7-9ea78fc6c8a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.189s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:54:21 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097648.1292996, 7492f540-2a69-463c-82f7-9ea78fc6c8a6 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:23 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] VM Stopped (Lifecycle Event)
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-eea382ec-07d3-4350-b2eb-1108b1efe932 None None] [instance: 7492f540-2a69-463c-82f7-9ea78fc6c8a6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:25 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7460MB free_disk=25.743732452392578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Applying migration context for instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed as it has an incoming, in-progress migration cc11fdd5-a118-433d-ab59-6ae612211627. Migration status is finished {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 00:54:25 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating resource usage from migration cc11fdd5-a118-433d-ab59-6ae612211627
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Migration cc11fdd5-a118-433d-ab59-6ae612211627 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:54:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:54:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:54:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Port f4a1c5ef-9fa2-4b59-98a2-1b220f512442 binding to destination host user is already ACTIVE {{(pid=73458) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 00:54:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Creating tmpfile /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/tmpqds560qj to verify with other compute node that the instance is on the same shared storage. {{(pid=73458) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance destroyed successfully.
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'resources' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a1c5ef-9f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:54:36 user nova-compute[73458]: INFO os_vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:54:36 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f9cfd6-0b17-449e-ad6c-c2dcb1ff7f5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e2f011-148d-4e7f-9d07-8f1103596025]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:36 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:36 user nova-compute[73458]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78519cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4bfece-efd5-4f19-ad20-163869d3020e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfde3ab-4228-4fe0-bb26-911e53c664a8]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b6bab-0db8-4fa7-b942-06748967c698]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:36 user nova-compute[73458]: WARNING nova.compute.manager [req-4c0983b8-afc2-430f-be0f-fe1cfc3d0b22 req-2ee58bc4-a1f0-43a0-b1d2-b7673f66e94b service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state resized and task_state resize_reverting.
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c6163-c523-48ba-a464-c323e4ad8071]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[979e95df-1e25-44df-83f4-10246955f4ab]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfc13e-c61e-4438-8b31-a57ed4f8c6cc]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:54:36 user nova-compute[73458]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:54:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a3a827-f537-47fe-b4bf-f51be687b40a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== disconnect_volume: return (329ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:54:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'migration_context' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Object Instance<014595b9-5cb2-4a12-a96c-b57ee091c8ed> lazy-loaded attributes: resources,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.579s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:38 user nova-compute[73458]: INFO nova.compute.manager [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Swapping old allocation on dict_keys(['3dbe5db4-8c3d-4097-8fbe-32da614b3f79']) held by migration cc11fdd5-a118-433d-ab59-6ae612211627 for instance
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:38 user nova-compute[73458]: WARNING nova.compute.manager [req-4a5909ea-90d5-4c7f-8a12-ebcaec0b6b1f req-c4b1ff54-3bbb-4b79-a389-1522cee3e291 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state resized and task_state resize_reverting.
Aug 27 00:54:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Overwriting current allocation {'allocations': {'3dbe5db4-8c3d-4097-8fbe-32da614b3f79': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '580bff8187b74188bf3d77bb1413ba5d', 'user_id': '01ccff6ef49a4362a6576ccf9cbbf552', 'consumer_generation': 1} on consumer 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 27 00:54:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquired lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Releasing lock "refresh_cache-014595b9-5cb2-4a12-a96c-b57ee091c8ed" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa403fe-e257-4ea6-84a7-59389ed224c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30400ec-9e7c-4a5e-8385-28d0fc895fd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79089bb8-c693-4acc-b745-81415501ec0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eb3b03-4ee8-49f7-afa1-7b73dff3f4a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:54:40 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5238c79-a358-41e9-be5a-fc8da775c7de]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:54:40 user nova-compute[73458]: INFO nova.compute.claims [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Claim successful on node user
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:54:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:54:40 user nova-compute[73458]: DEBUG nova.policy [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '017197a0401c456f97c4260b62669916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726b2aaef554069ace63df4c4e92717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:54:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Creating image(s)
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk 1073741824" returned: 0 in 0.065s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Successfully created port: c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Cannot resize image /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Ensure instance console log exists: /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Successfully updated port: c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing instance network info cache due to event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.neutron [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance network_info: |[{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.neutron [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start _get_guest_xml network_info=[{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:54:43 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:43 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2BhiUFgHSdo4/YvXrdIeWNxmJCq86bCymbFfKa01U9yO3cnwit6zjH+B4IcyUD3gCYhT5If75KDME6CdpbpKJSVrT6eH5WPgg5+IxCbIr3FvgN/LDnvOhRZbjUOFUyvg==',key_name='tempest-keypair-1066942134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_devices' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:54:43 user nova-compute[73458]:   <uuid>a261c7ca-0d55-492e-8601-d5819b9d8fee</uuid>
Aug 27 00:54:43 user nova-compute[73458]:   <name>instance-00000011</name>
Aug 27 00:54:43 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:54:43 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:54:43 user nova-compute[73458]:   <metadata>
Aug 27 00:54:43 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:54:43 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-894961662</nova:name>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:54:43</nova:creationTime>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:54:43 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:54:43 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:owner>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:user uuid="017197a0401c456f97c4260b62669916">tempest-AttachVolumeShelveTestJSON-462549752-project-member</nova:user>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:project uuid="d726b2aaef554069ace63df4c4e92717">tempest-AttachVolumeShelveTestJSON-462549752</nova:project>
Aug 27 00:54:43 user nova-compute[73458]:       </nova:owner>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:54:43 user nova-compute[73458]:       <nova:ports>
Aug 27 00:54:43 user nova-compute[73458]:         <nova:port uuid="c529fc8d-8b36-43bb-8302-f5d042c772b4">
Aug 27 00:54:43 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 00:54:43 user nova-compute[73458]:         </nova:port>
Aug 27 00:54:43 user nova-compute[73458]:       </nova:ports>
Aug 27 00:54:43 user nova-compute[73458]:     </nova:instance>
Aug 27 00:54:43 user nova-compute[73458]:   </metadata>
Aug 27 00:54:43 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:54:43 user nova-compute[73458]:     <system>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="serial">a261c7ca-0d55-492e-8601-d5819b9d8fee</entry>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="uuid">a261c7ca-0d55-492e-8601-d5819b9d8fee</entry>
Aug 27 00:54:43 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:54:43 user nova-compute[73458]:     </system>
Aug 27 00:54:43 user nova-compute[73458]:   </sysinfo>
Aug 27 00:54:43 user nova-compute[73458]:   <os>
Aug 27 00:54:43 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:54:43 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:54:43 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:54:43 user nova-compute[73458]:   </os>
Aug 27 00:54:43 user nova-compute[73458]:   <features>
Aug 27 00:54:43 user nova-compute[73458]:     <acpi/>
Aug 27 00:54:43 user nova-compute[73458]:     <apic/>
Aug 27 00:54:43 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:54:43 user nova-compute[73458]:   </features>
Aug 27 00:54:43 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:54:43 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:54:43 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:54:43 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:54:43 user nova-compute[73458]:   </clock>
Aug 27 00:54:43 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:54:43 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:54:43 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:54:43 user nova-compute[73458]:   </cpu>
Aug 27 00:54:43 user nova-compute[73458]:   <devices>
Aug 27 00:54:43 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:54:43 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:54:43 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk"/>
Aug 27 00:54:43 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:54:43 user nova-compute[73458]:     </disk>
Aug 27 00:54:43 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:54:43 user nova-compute[73458]:       <mac address="fa:16:3e:f2:c0:4f"/>
Aug 27 00:54:43 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:54:43 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:54:43 user nova-compute[73458]:       <target dev="tapc529fc8d-8b"/>
Aug 27 00:54:43 user nova-compute[73458]:     </interface>
Aug 27 00:54:43 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:54:43 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/console.log" append="off"/>
Aug 27 00:54:43 user nova-compute[73458]:     </serial>
Aug 27 00:54:43 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:54:43 user nova-compute[73458]:     <video>
Aug 27 00:54:43 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:54:43 user nova-compute[73458]:     </video>
Aug 27 00:54:43 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:54:43 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:54:43 user nova-compute[73458]:     </rng>
Aug 27 00:54:43 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:54:43 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:54:43 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:54:43 user nova-compute[73458]:     </memballoon>
Aug 27 00:54:43 user nova-compute[73458]:   </devices>
Aug 27 00:54:43 user nova-compute[73458]: </domain>
Aug 27 00:54:43 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2BhiUFgHSdo4/YvXrdIeWNxmJCq86bCymbFfKa01U9yO3cnwit6zjH+B4IcyUD3gCYhT5If75KDME6CdpbpKJSVrT6eH5WPgg5+IxCbIr3FvgN/LDnvOhRZbjUOFUyvg==',key_name='tempest-keypair-1066942134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG os_vif [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc529fc8d-8b, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc529fc8d-8b, col_values=(('external_ids', {'iface-id': 'c529fc8d-8b36-43bb-8302-f5d042c772b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:c0:4f', 'vm-uuid': 'a261c7ca-0d55-492e-8601-d5819b9d8fee'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:43 user nova-compute[73458]: INFO os_vif [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b')
Aug 27 00:54:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:54:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No VIF found with MAC fa:16:3e:f2:c0:4f, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG nova.network.neutron [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updated VIF entry in instance network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG nova.network.neutron [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91b6eb38-0d70-4c84-aee3-16f379a27ade req-cef524f1-5fa3-45b4-ae85-169a6fa5039a service nova] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:44 user nova-compute[73458]: WARNING nova.compute.manager [req-373f33b6-640d-42fa-a780-77d67b6d74d1 req-61c7907f-07f3-40bd-9014-1d540fe85a76 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state building and task_state spawning.
Aug 27 00:54:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097686.9351547, a261c7ca-0d55-492e-8601-d5819b9d8fee => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Resumed (Lifecycle Event)
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:54:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance spawned successfully.
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:54:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097686.9359527, a261c7ca-0d55-492e-8601-d5819b9d8fee => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Started (Lifecycle Event)
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:47 user nova-compute[73458]: WARNING nova.compute.manager [req-6c0173dc-a5ef-4d6e-9167-a9ff5fd2bb49 req-b4775027-34fa-486a-baf8-b8096a32b608 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state building and task_state spawning.
Aug 27 00:54:47 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:54:47 user nova-compute[73458]: INFO nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:47 user nova-compute[73458]: INFO nova.compute.manager [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Took 6.84 seconds to build instance.
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-985ed8e9-d754-479f-bd5b-0bbd92bf3ad3 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing instance network info cache due to event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated VIF entry in instance network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:54:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e835ce7-04b5-42b9-bd6a-e2a44d92a122 req-54d56e30-b2b2-4796-a058-1fd2e1fdfffb service nova] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:54:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:48 user nova-compute[73458]: INFO nova.compute.manager [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] instance snapshotting
Aug 27 00:54:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Beginning live snapshot process
Aug 27 00:54:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json -f qcow2" returned: 0 in 0.270s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7.delta 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7.delta 1073741824" returned: 0 in 0.053s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:54:50 user nova-compute[73458]: WARNING nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 9f140de9-a7eb-4041-a79f-241a9f85b35b {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 2317c1cf-8971-489e-928f-93a3a0ddf2b8 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: INFO nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: INFO nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] During sync_power_state the instance has a pending task (image_pending_upload). Skip.
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:54:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:54:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7.delta /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097676.5132072, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:51 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Stopped (Lifecycle Event)
Aug 27 00:54:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7.delta /opt/stack/data/nova/instances/snapshots/tmp2zujja4z/9f9f4766ebe640a09e6e25a68bcdacb7" returned: 0 in 0.548s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:51 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Snapshot extracted, beginning image upload
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-970cfc5d-a7a7-41f0-8077-5eecb7c1cd4b None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Starting finish_revert_migration {{(pid=73458) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start _get_guest_xml network_info=[{"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '014595b9-5cb2-4a12-a96c-b57ee091c8ed', 'attached_at': '2023-08-27T00:54:52.000000', 'detached_at': '', 'volume_id': '3e6cde00-d755-4505-950f-29c7eff8f633', 'serial': '3e6cde00-d755-4505-950f-29c7eff8f633'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'cb697564-b3e9-4934-8980-11c6bd8b1149', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:54:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'vcpu_model' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:54:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:54:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:54:51 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:54:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[29617869-5eb8-4bf3-a9d0-80ebb827aeca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:54:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50fd19-35e4-4e35-9f48-da5051607deb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633] added
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3208f2d-c97d-494d-8c14-abdcd4d01b95]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfcccf2-a8e3-48f7-8c14-34fa79febb21]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVmybSO" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcac027-28bd-4b3f-b144-b50a27363914]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heVmybSO'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d56bbd-91f3-4b00-9c57-a573ce9bcee3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8fb9a-9705-49f7-991a-f6241aadec02]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1177d7-9944-40f9-8e36-378a7665bc20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:54:52 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4347075d-8cce-4bb5-981e-78aa46c1d17c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4e838a-1102-4351-aaa8-9750c364c6d4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:52 user nova-compute[73458]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:54:52 user nova-compute[73458]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:54:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99052f8-66cd-4c7f-95a5-3fee2d94fbed]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:54:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330663863383739', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:54:53 user nova-compute[73458]:   <uuid>014595b9-5cb2-4a12-a96c-b57ee091c8ed</uuid>
Aug 27 00:54:53 user nova-compute[73458]:   <name>instance-00000003</name>
Aug 27 00:54:53 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:54:53 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:54:53 user nova-compute[73458]:   <metadata>
Aug 27 00:54:53 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:54:53 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherB-server-193534920</nova:name>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:54:51</nova:creationTime>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:54:53 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:54:53 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:owner>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:user uuid="01ccff6ef49a4362a6576ccf9cbbf552">tempest-ServerActionsTestOtherB-1527688410-project-member</nova:user>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:project uuid="580bff8187b74188bf3d77bb1413ba5d">tempest-ServerActionsTestOtherB-1527688410</nova:project>
Aug 27 00:54:53 user nova-compute[73458]:       </nova:owner>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:54:53 user nova-compute[73458]:       <nova:ports>
Aug 27 00:54:53 user nova-compute[73458]:         <nova:port uuid="f4a1c5ef-9fa2-4b59-98a2-1b220f512442">
Aug 27 00:54:53 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 00:54:53 user nova-compute[73458]:         </nova:port>
Aug 27 00:54:53 user nova-compute[73458]:       </nova:ports>
Aug 27 00:54:53 user nova-compute[73458]:     </nova:instance>
Aug 27 00:54:53 user nova-compute[73458]:   </metadata>
Aug 27 00:54:53 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:54:53 user nova-compute[73458]:     <system>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="serial">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="uuid">014595b9-5cb2-4a12-a96c-b57ee091c8ed</entry>
Aug 27 00:54:53 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:54:53 user nova-compute[73458]:     </system>
Aug 27 00:54:53 user nova-compute[73458]:   </sysinfo>
Aug 27 00:54:53 user nova-compute[73458]:   <os>
Aug 27 00:54:53 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:54:53 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:54:53 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:54:53 user nova-compute[73458]:   </os>
Aug 27 00:54:53 user nova-compute[73458]:   <features>
Aug 27 00:54:53 user nova-compute[73458]:     <acpi/>
Aug 27 00:54:53 user nova-compute[73458]:     <apic/>
Aug 27 00:54:53 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:54:53 user nova-compute[73458]:   </features>
Aug 27 00:54:53 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:54:53 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:54:53 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:54:53 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:54:53 user nova-compute[73458]:   </clock>
Aug 27 00:54:53 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:54:53 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:54:53 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:54:53 user nova-compute[73458]:   </cpu>
Aug 27 00:54:53 user nova-compute[73458]:   <devices>
Aug 27 00:54:53 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:54:53 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:54:53 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk"/>
Aug 27 00:54:53 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:54:53 user nova-compute[73458]:     </disk>
Aug 27 00:54:53 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:54:53 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:54:53 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 00:54:53 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:54:53 user nova-compute[73458]:       <serial>3e6cde00-d755-4505-950f-29c7eff8f633</serial>
Aug 27 00:54:53 user nova-compute[73458]:     </disk>
Aug 27 00:54:53 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:54:53 user nova-compute[73458]:       <mac address="fa:16:3e:e4:e1:1e"/>
Aug 27 00:54:53 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:54:53 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:54:53 user nova-compute[73458]:       <target dev="tapf4a1c5ef-9f"/>
Aug 27 00:54:53 user nova-compute[73458]:     </interface>
Aug 27 00:54:53 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:54:53 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/console.log" append="off"/>
Aug 27 00:54:53 user nova-compute[73458]:     </serial>
Aug 27 00:54:53 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:54:53 user nova-compute[73458]:     <video>
Aug 27 00:54:53 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:54:53 user nova-compute[73458]:     </video>
Aug 27 00:54:53 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:54:53 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:54:53 user nova-compute[73458]:     </rng>
Aug 27 00:54:53 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:54:53 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:54:53 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:54:53 user nova-compute[73458]:     </memballoon>
Aug 27 00:54:53 user nova-compute[73458]:   </devices>
Aug 27 00:54:53 user nova-compute[73458]: </domain>
Aug 27 00:54:53 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG os_vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4a1c5ef-9f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4a1c5ef-9f, col_values=(('external_ids', {'iface-id': 'f4a1c5ef-9fa2-4b59-98a2-1b220f512442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:e1:1e', 'vm-uuid': '014595b9-5cb2-4a12-a96c-b57ee091c8ed'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:53 user nova-compute[73458]: INFO os_vif [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:54:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Snapshot image upload complete
Aug 27 00:54:54 user nova-compute[73458]: INFO nova.compute.manager [None req-f38ea7fc-4cb6-47f2-8727-d35cfc3b43ab tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Took 5.61 seconds to snapshot the instance on the hypervisor.
Aug 27 00:54:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:55 user nova-compute[73458]: WARNING nova.compute.manager [req-f799aecb-c9dd-4f69-8630-3867a8292fc6 req-d08223d4-552e-42c0-bc76-eab0ae9763b1 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state resized and task_state resize_reverting.
Aug 27 00:54:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097697.0738192, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Resumed (Lifecycle Event)
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance running successfully.
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] finish_revert_migration finished successfully. {{(pid=73458) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097697.0757709, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Started (Lifecycle Event)
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:54:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:54:57 user nova-compute[73458]: WARNING nova.compute.manager [req-cd55ebcb-38e2-47df-876d-08e11493bf41 req-ce89eb6f-c0ab-42bb-95db-f8113a1da1cb service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state resized and task_state resize_reverting.
Aug 27 00:54:57 user nova-compute[73458]: INFO nova.compute.manager [None req-c6bdac89-5762-4f90-85d3-bdee6dec20a5 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance to original state: 'active'
Aug 27 00:54:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:54:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:12 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:55:12 user nova-compute[73458]: INFO nova.compute.claims [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Claim successful on node user
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:55:13 user nova-compute[73458]: INFO nova.compute.claims [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Claim successful on node user
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.policy [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a7573d764b4cc0a7af57c45323c4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1972e3c8fd486bac81a90b489714ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:55:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Creating image(s)
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.203s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk 1073741824" returned: 0 in 0.050s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Successfully created port: 9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.policy [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a7573d764b4cc0a7af57c45323c4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1972e3c8fd486bac81a90b489714ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:55:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Creating image(s)
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Cannot resize image /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Ensure instance console log exists: /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.209s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.203s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk 1073741824" returned: 0 in 0.060s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Successfully updated port: 9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-changed-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Refreshing instance network info cache due to event network-changed-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Cannot resize image /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Ensure instance console log exists: /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:55:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Successfully created port: ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance network_info: |[{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Refreshing network info cache for port 9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start _get_guest_xml network_info=[{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:55:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65952474',display_name='tempest-ServerRescueNegativeTestJSON-server-65952474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-65952474',id=18,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-fep447l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:14Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=8377d9b5-a8c1-48be-be16-be1ace928d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:55:16 user nova-compute[73458]:   <uuid>8377d9b5-a8c1-48be-be16-be1ace928d3f</uuid>
Aug 27 00:55:16 user nova-compute[73458]:   <name>instance-00000012</name>
Aug 27 00:55:16 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:55:16 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:55:16 user nova-compute[73458]:   <metadata>
Aug 27 00:55:16 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:55:16 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-65952474</nova:name>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:55:16</nova:creationTime>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:55:16 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:55:16 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:owner>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 00:55:16 user nova-compute[73458]:       </nova:owner>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:55:16 user nova-compute[73458]:       <nova:ports>
Aug 27 00:55:16 user nova-compute[73458]:         <nova:port uuid="9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9">
Aug 27 00:55:16 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 00:55:16 user nova-compute[73458]:         </nova:port>
Aug 27 00:55:16 user nova-compute[73458]:       </nova:ports>
Aug 27 00:55:16 user nova-compute[73458]:     </nova:instance>
Aug 27 00:55:16 user nova-compute[73458]:   </metadata>
Aug 27 00:55:16 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:55:16 user nova-compute[73458]:     <system>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="serial">8377d9b5-a8c1-48be-be16-be1ace928d3f</entry>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="uuid">8377d9b5-a8c1-48be-be16-be1ace928d3f</entry>
Aug 27 00:55:16 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:55:16 user nova-compute[73458]:     </system>
Aug 27 00:55:16 user nova-compute[73458]:   </sysinfo>
Aug 27 00:55:16 user nova-compute[73458]:   <os>
Aug 27 00:55:16 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:55:16 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:55:16 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:55:16 user nova-compute[73458]:   </os>
Aug 27 00:55:16 user nova-compute[73458]:   <features>
Aug 27 00:55:16 user nova-compute[73458]:     <acpi/>
Aug 27 00:55:16 user nova-compute[73458]:     <apic/>
Aug 27 00:55:16 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:55:16 user nova-compute[73458]:   </features>
Aug 27 00:55:16 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:55:16 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:55:16 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:55:16 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:55:16 user nova-compute[73458]:   </clock>
Aug 27 00:55:16 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:55:16 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:55:16 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:55:16 user nova-compute[73458]:   </cpu>
Aug 27 00:55:16 user nova-compute[73458]:   <devices>
Aug 27 00:55:16 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:55:16 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:55:16 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk"/>
Aug 27 00:55:16 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:55:16 user nova-compute[73458]:     </disk>
Aug 27 00:55:16 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:55:16 user nova-compute[73458]:       <mac address="fa:16:3e:9e:a8:83"/>
Aug 27 00:55:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:16 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:55:16 user nova-compute[73458]:       <target dev="tap9de9d84c-1e"/>
Aug 27 00:55:16 user nova-compute[73458]:     </interface>
Aug 27 00:55:16 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:55:16 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/console.log" append="off"/>
Aug 27 00:55:16 user nova-compute[73458]:     </serial>
Aug 27 00:55:16 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:55:16 user nova-compute[73458]:     <video>
Aug 27 00:55:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:16 user nova-compute[73458]:     </video>
Aug 27 00:55:16 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:55:16 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:55:16 user nova-compute[73458]:     </rng>
Aug 27 00:55:16 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:55:16 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:55:16 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:55:16 user nova-compute[73458]:     </memballoon>
Aug 27 00:55:16 user nova-compute[73458]:   </devices>
Aug 27 00:55:16 user nova-compute[73458]: </domain>
Aug 27 00:55:16 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65952474',display_name='tempest-ServerRescueNegativeTestJSON-server-65952474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-65952474',id=18,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-fep447l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:14Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=8377d9b5-a8c1-48be-be16-be1ace928d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG os_vif [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9de9d84c-1e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9de9d84c-1e, col_values=(('external_ids', {'iface-id': '9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a8:83', 'vm-uuid': '8377d9b5-a8c1-48be-be16-be1ace928d3f'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:16 user nova-compute[73458]: INFO os_vif [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e')
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:9e:a8:83, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updated VIF entry in instance network info cache for port 9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3a0f1e3e-be75-4d88-a3a8-3a41108a7ff0 req-5a233fbf-c1cb-40a7-870d-2e00de544c7d service nova] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Successfully updated port: ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-changed-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Refreshing instance network info cache due to event network-changed-ce905a94-63c3-4499-a048-5592b852d701. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] Acquiring lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance network_info: |[{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] Acquired lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Refreshing network info cache for port ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start _get_guest_xml network_info=[{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:55:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:17 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-509786178',display_name='tempest-ServerRescueNegativeTestJSON-server-509786178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-509786178',id=19,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-gd2zn0az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:15Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=c4b43432-4735-496d-a9e9-79a264633d35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:55:17 user nova-compute[73458]:   <uuid>c4b43432-4735-496d-a9e9-79a264633d35</uuid>
Aug 27 00:55:17 user nova-compute[73458]:   <name>instance-00000013</name>
Aug 27 00:55:17 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:55:17 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:55:17 user nova-compute[73458]:   <metadata>
Aug 27 00:55:17 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:55:17 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-509786178</nova:name>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:55:17</nova:creationTime>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:55:17 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:55:17 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:owner>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 00:55:17 user nova-compute[73458]:       </nova:owner>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:55:17 user nova-compute[73458]:       <nova:ports>
Aug 27 00:55:17 user nova-compute[73458]:         <nova:port uuid="ce905a94-63c3-4499-a048-5592b852d701">
Aug 27 00:55:17 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 00:55:17 user nova-compute[73458]:         </nova:port>
Aug 27 00:55:17 user nova-compute[73458]:       </nova:ports>
Aug 27 00:55:17 user nova-compute[73458]:     </nova:instance>
Aug 27 00:55:17 user nova-compute[73458]:   </metadata>
Aug 27 00:55:17 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:55:17 user nova-compute[73458]:     <system>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="serial">c4b43432-4735-496d-a9e9-79a264633d35</entry>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="uuid">c4b43432-4735-496d-a9e9-79a264633d35</entry>
Aug 27 00:55:17 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:55:17 user nova-compute[73458]:     </system>
Aug 27 00:55:17 user nova-compute[73458]:   </sysinfo>
Aug 27 00:55:17 user nova-compute[73458]:   <os>
Aug 27 00:55:17 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:55:17 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:55:17 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:55:17 user nova-compute[73458]:   </os>
Aug 27 00:55:17 user nova-compute[73458]:   <features>
Aug 27 00:55:17 user nova-compute[73458]:     <acpi/>
Aug 27 00:55:17 user nova-compute[73458]:     <apic/>
Aug 27 00:55:17 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:55:17 user nova-compute[73458]:   </features>
Aug 27 00:55:17 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:55:17 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:55:17 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:55:17 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:55:17 user nova-compute[73458]:   </clock>
Aug 27 00:55:17 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:55:17 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:55:17 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:55:17 user nova-compute[73458]:   </cpu>
Aug 27 00:55:17 user nova-compute[73458]:   <devices>
Aug 27 00:55:17 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:55:17 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:55:17 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk"/>
Aug 27 00:55:17 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:55:17 user nova-compute[73458]:     </disk>
Aug 27 00:55:17 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:55:17 user nova-compute[73458]:       <mac address="fa:16:3e:b6:1e:93"/>
Aug 27 00:55:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:17 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:55:17 user nova-compute[73458]:       <target dev="tapce905a94-63"/>
Aug 27 00:55:17 user nova-compute[73458]:     </interface>
Aug 27 00:55:17 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:55:17 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/console.log" append="off"/>
Aug 27 00:55:17 user nova-compute[73458]:     </serial>
Aug 27 00:55:17 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:55:17 user nova-compute[73458]:     <video>
Aug 27 00:55:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:17 user nova-compute[73458]:     </video>
Aug 27 00:55:17 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:55:17 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:55:17 user nova-compute[73458]:     </rng>
Aug 27 00:55:17 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:55:17 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:55:17 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:55:17 user nova-compute[73458]:     </memballoon>
Aug 27 00:55:17 user nova-compute[73458]:   </devices>
Aug 27 00:55:17 user nova-compute[73458]: </domain>
Aug 27 00:55:17 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-509786178',display_name='tempest-ServerRescueNegativeTestJSON-server-509786178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-509786178',id=19,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-gd2zn0az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:15Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=c4b43432-4735-496d-a9e9-79a264633d35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG os_vif [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce905a94-63, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce905a94-63, col_values=(('external_ids', {'iface-id': 'ce905a94-63c3-4499-a048-5592b852d701', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:1e:93', 'vm-uuid': 'c4b43432-4735-496d-a9e9-79a264633d35'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: INFO os_vif [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63')
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:b6:1e:93, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updated VIF entry in instance network info cache for port ce905a94-63c3-4499-a048-5592b852d701. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4be75005-85d0-440f-a6f3-215016904fef req-35ca2ffa-0733-420b-b653-64e459d941de service nova] Releasing lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:17 user nova-compute[73458]: WARNING nova.compute.manager [req-37bfa1f0-9ac4-4e30-a658-cfb750dfbd8d req-b55713be-a42d-4111-b312-25cdc2a5ea4b service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state building and task_state spawning.
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:19 user nova-compute[73458]: WARNING nova.compute.manager [req-285f26d2-96d8-4cc9-b09a-2c54cf2d5642 req-d6938446-67d1-4be6-b26f-eee550d42c1e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state building and task_state spawning.
Aug 27 00:55:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:19 user nova-compute[73458]: WARNING nova.compute.manager [req-a5dc0adf-c5a1-4f49-a708-6cc7ed5ffed4 req-d74896ba-099c-47a1-9e63-b77624661351 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state building and task_state spawning.
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097720.9109874, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Resumed (Lifecycle Event)
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:55:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance spawned successfully.
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097720.9122267, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Started (Lifecycle Event)
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Took 7.13 seconds to spawn the instance on the hypervisor.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Took 8.30 seconds to build instance.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-544dda7f-45c7-4994-9c3a-70a1abd003f9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.425s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:21 user nova-compute[73458]: WARNING nova.compute.manager [req-7ca23839-a66c-4f99-855b-7cabd242ab45 req-e398a918-c4a1-4752-be7b-a8590802d733 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state building and task_state spawning.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097721.6392357, c4b43432-4735-496d-a9e9-79a264633d35 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] VM Resumed (Lifecycle Event)
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance spawned successfully.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097721.6407087, c4b43432-4735-496d-a9e9-79a264633d35 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] VM Started (Lifecycle Event)
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:21 user nova-compute[73458]: INFO nova.compute.manager [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Took 7.98 seconds to build instance.
Aug 27 00:55:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8d38ba7e-11c2-41ad-ae8c-9e9719f0fd94 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.082s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:55:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:26 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:26 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:26 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.66930389404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a261c7ca-0d55-492e-8601-d5819b9d8fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:55:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:28 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:55:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:55:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing instance network info cache due to event network-changed-cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] Acquiring lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] Acquired lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Refreshing network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:30 user nova-compute[73458]: INFO nova.compute.manager [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Terminating instance
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e404602-ae78-4f08-99e0-1092c5470cef req-ca462332-a791-4111-975c-7e89f9508222 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-unplugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updated VIF entry in instance network info cache for port cb535f02-3171-47c1-b52a-71ec0b82a909. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [{"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ee32b844-2fae-435d-9d57-e5aa61455827 req-0437a0bb-97f0-49ec-8065-2a6301dd7290 service nova] Releasing lock "refresh_cache-68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Instance destroyed successfully.
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lazy-loading 'resources' on Instance uuid 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:49:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1612863848',display_name='tempest-TestShelveInstance-server-1612863848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1612863848',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNr9+Bcj55+eAAbtn6uoPjvS3HJqBnQ5GIv/tanXPyPqjUCQh/QGAmuwaVq5tYljoyW+XlYSEJ96JRyHrfTnsoCS2rvs79uH0Anx3qMgM5HtufDcgnnbDLU+IKZ71FgGg==',key_name='tempest-TestShelveInstance-1424313510',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='872acb80a3aa45cc904b6a0ecd846a24',ramdisk_id='',reservation_id='r-35ges075',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1196851470',owner_user_name='tempest-TestShelveInstance-1196851470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:54:00Z,user_data=None,user_id='bcdf4d7863614457b38647daca7f705b',uuid=68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converting VIF {"id": "cb535f02-3171-47c1-b52a-71ec0b82a909", "address": "fa:16:3e:c1:1d:4c", "network": {"id": "b2ac8283-57f8-4866-9a33-2ab3b9da4ef9", "bridge": "br-int", "label": "tempest-TestShelveInstance-418998203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872acb80a3aa45cc904b6a0ecd846a24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb535f02-31", "ovs_interfaceid": "cb535f02-3171-47c1-b52a-71ec0b82a909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_vif [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb535f02-31, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:31 user nova-compute[73458]: INFO os_vif [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:1d:4c,bridge_name='br-int',has_traffic_filtering=True,id=cb535f02-3171-47c1-b52a-71ec0b82a909,network=Network(b2ac8283-57f8-4866-9a33-2ab3b9da4ef9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb535f02-31')
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srvNaoiK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:55:31 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7200e5dd-2e18-474d-97f3-c396903d85fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4148f62f-95d5-4cc0-9d0a-92894d5ff23a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:55:31 user nova-compute[73458]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:55:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa (non-flash)
Aug 27 00:55:31 user nova-compute[73458]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:55:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7872a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ace30-6e2b-4347-9bc9-6e1c59b9daa6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a3ff4e-46f6-4a81-9e55-29ffd325485b]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbbc7c-cc15-468b-aa50-f5293958bfdb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c2f819-ae37-48ae-a4ee-fafe2a9fcf96]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO395a8327-000a75c1b0ceead8', '/dev/disk/by-id/scsi-23030306137356331', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_395a8327') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e979e3c-29d4-4528-bace-d228e85fb63f]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b580fd5f-14d3-44f2-ae70-cd90462e7d85]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9f1417-8c40-4c94-989a-4fabaa7563e1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260]
Aug 27 00:55:31 user nova-compute[73458]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa, portal: 172.16.0.220,3260] successful.
Aug 27 00:55:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca9a6eb3-46e5-48fc-99ea-976b63e477aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d26db-dfde-49c5-8ac6-7005c321cef4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] <== disconnect_volume: return (291ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:55:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deleting instance files /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f_del
Aug 27 00:55:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deletion of /opt/stack/data/nova/instances/68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f_del complete
Aug 27 00:55:31 user nova-compute[73458]: INFO nova.compute.manager [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 27 00:55:31 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:55:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:31 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Took 0.43 seconds to deallocate network for instance.
Aug 27 00:55:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-fe8ab23c-486f-42b6-abf0-54b9e8838eaa req-73af088c-67d2-409d-8856-20a303e43c2d service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-deleted-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] Acquiring lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] No waiting events found dispatching network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:32 user nova-compute[73458]: WARNING nova.compute.manager [req-2a9d233d-be93-4e14-b752-ec7d6d334556 req-6ac501f2-9e2a-47e1-856a-ddc38cbb86a2 service nova] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Received unexpected event network-vif-plugged-cb535f02-3171-47c1-b52a-71ec0b82a909 for instance with vm_state active and task_state deleting.
Aug 27 00:55:32 user nova-compute[73458]: INFO nova.compute.manager [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Took 0.93 seconds to detach 1 volumes for instance.
Aug 27 00:55:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Deleting volume: ca9a6eb3-46e5-48fc-99ea-976b63e477aa {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:55:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:55:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:33 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Deleted allocations for instance 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f
Aug 27 00:55:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-34a4c861-dec6-4dca-9cce-9b19c7ffa895 tempest-TestShelveInstance-1196851470 tempest-TestShelveInstance-1196851470-project-member] Lock "68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.261s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:35 user nova-compute[73458]: INFO nova.compute.manager [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] instance snapshotting
Aug 27 00:55:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Beginning live snapshot process
Aug 27 00:55:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10.delta 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10.delta 1073741824" returned: 0 in 0.062s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 00:55:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:55:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 14680064 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:55:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 00:55:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 00:55:38 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:55:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10.delta /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10.delta /opt/stack/data/nova/instances/snapshots/tmp6tsa09rk/406548a5e33348929452576b74646f10" returned: 0 in 0.438s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Snapshot extracted, beginning image upload
Aug 27 00:55:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Snapshot image upload complete
Aug 27 00:55:41 user nova-compute[73458]: INFO nova.compute.manager [None req-376137a1-551b-4532-8be1-9c2c0a6f050d tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Took 5.85 seconds to snapshot the instance on the hypervisor.
Aug 27 00:55:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097731.0370972, 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:46 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] VM Stopped (Lifecycle Event)
Aug 27 00:55:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dbebdcb1-4c7c-4077-8464-f901aa208f45 None None] [instance: 68e2c640-0eeb-4e8e-96ce-d3ef9fe8185f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-changed-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Refreshing instance network info cache due to event network-changed-c71ca2d8-85d2-4130-8f81-88cc241c9c66. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] Acquiring lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] Acquired lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Refreshing network info cache for port c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:55:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updated VIF entry in instance network info cache for port c71ca2d8-85d2-4130-8f81-88cc241c9c66. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:55:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updating instance_info_cache with network_info: [{"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91474c76-0641-4012-9e4a-337a8534179a req-a51f92f5-3055-4a83-bce8-8bb3b60b24f0 service nova] Releasing lock "refresh_cache-a800258d-520b-4e76-90b4-0f7b2c8f3adc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:55:48 user nova-compute[73458]: INFO nova.compute.claims [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Claim successful on node user
Aug 27 00:55:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:55:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:55:48 user nova-compute[73458]: DEBUG nova.policy [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15e8844b6f594cef9e904b88a6ca42b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd605e8ac6e749718ba402ae385a24bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:55:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Creating image(s)
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk 1073741824" returned: 0 in 0.056s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Successfully created port: 0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:55:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Cannot resize image /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Ensure instance console log exists: /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Successfully updated port: 0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-changed-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Refreshing instance network info cache due to event network-changed-0e1f9cd4-9e02-4736-a736-0c8056657be9. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] Acquiring lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:55:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.neutron [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating instance_info_cache with network_info: [{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance network_info: |[{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] Acquired lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Refreshing network info cache for port 0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start _get_guest_xml network_info=[{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:55:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-tempest.common.compute-instance-696159245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:55:51 user nova-compute[73458]:   <uuid>4d0794fa-2561-4577-bb68-08fe675d50e4</uuid>
Aug 27 00:55:51 user nova-compute[73458]:   <name>instance-00000014</name>
Aug 27 00:55:51 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:55:51 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:55:51 user nova-compute[73458]:   <metadata>
Aug 27 00:55:51 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:55:51 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:name>tempest-tempest.common.compute-instance-696159245</nova:name>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:55:51</nova:creationTime>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:55:51 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:55:51 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:owner>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:user uuid="15e8844b6f594cef9e904b88a6ca42b9">tempest-ServerActionsTestOtherA-1449025138-project-member</nova:user>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:project uuid="bd605e8ac6e749718ba402ae385a24bd">tempest-ServerActionsTestOtherA-1449025138</nova:project>
Aug 27 00:55:51 user nova-compute[73458]:       </nova:owner>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:55:51 user nova-compute[73458]:       <nova:ports>
Aug 27 00:55:51 user nova-compute[73458]:         <nova:port uuid="0e1f9cd4-9e02-4736-a736-0c8056657be9">
Aug 27 00:55:51 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 00:55:51 user nova-compute[73458]:         </nova:port>
Aug 27 00:55:51 user nova-compute[73458]:       </nova:ports>
Aug 27 00:55:51 user nova-compute[73458]:     </nova:instance>
Aug 27 00:55:51 user nova-compute[73458]:   </metadata>
Aug 27 00:55:51 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:55:51 user nova-compute[73458]:     <system>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="serial">4d0794fa-2561-4577-bb68-08fe675d50e4</entry>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="uuid">4d0794fa-2561-4577-bb68-08fe675d50e4</entry>
Aug 27 00:55:51 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:55:51 user nova-compute[73458]:     </system>
Aug 27 00:55:51 user nova-compute[73458]:   </sysinfo>
Aug 27 00:55:51 user nova-compute[73458]:   <os>
Aug 27 00:55:51 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:55:51 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:55:51 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:55:51 user nova-compute[73458]:   </os>
Aug 27 00:55:51 user nova-compute[73458]:   <features>
Aug 27 00:55:51 user nova-compute[73458]:     <acpi/>
Aug 27 00:55:51 user nova-compute[73458]:     <apic/>
Aug 27 00:55:51 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:55:51 user nova-compute[73458]:   </features>
Aug 27 00:55:51 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:55:51 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:55:51 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:55:51 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:55:51 user nova-compute[73458]:   </clock>
Aug 27 00:55:51 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:55:51 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:55:51 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:55:51 user nova-compute[73458]:   </cpu>
Aug 27 00:55:51 user nova-compute[73458]:   <devices>
Aug 27 00:55:51 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:55:51 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:55:51 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk"/>
Aug 27 00:55:51 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:55:51 user nova-compute[73458]:     </disk>
Aug 27 00:55:51 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:55:51 user nova-compute[73458]:       <mac address="fa:16:3e:0d:64:50"/>
Aug 27 00:55:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:51 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:55:51 user nova-compute[73458]:       <target dev="tap0e1f9cd4-9e"/>
Aug 27 00:55:51 user nova-compute[73458]:     </interface>
Aug 27 00:55:51 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:55:51 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/console.log" append="off"/>
Aug 27 00:55:51 user nova-compute[73458]:     </serial>
Aug 27 00:55:51 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:55:51 user nova-compute[73458]:     <video>
Aug 27 00:55:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:55:51 user nova-compute[73458]:     </video>
Aug 27 00:55:51 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:55:51 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:55:51 user nova-compute[73458]:     </rng>
Aug 27 00:55:51 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:55:51 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:55:51 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:55:51 user nova-compute[73458]:     </memballoon>
Aug 27 00:55:51 user nova-compute[73458]:   </devices>
Aug 27 00:55:51 user nova-compute[73458]: </domain>
Aug 27 00:55:51 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-tempest.common.compute-instance-696159245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_vif [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e1f9cd4-9e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e1f9cd4-9e, col_values=(('external_ids', {'iface-id': '0e1f9cd4-9e02-4736-a736-0c8056657be9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:64:50', 'vm-uuid': '4d0794fa-2561-4577-bb68-08fe675d50e4'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:51 user nova-compute[73458]: INFO os_vif [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e')
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:0d:64:50, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'flavor' on Instance uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:51 user nova-compute[73458]: INFO nova.compute.manager [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Attaching volume a55d6ba0-2534-4e67-8c66-558f0202d4f7 to /dev/vdb
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updated VIF entry in instance network info cache for port 0e1f9cd4-9e02-4736-a736-0c8056657be9. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating instance_info_cache with network_info: [{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-46f82dec-1350-4ece-bae5-83fc3edfddf6 req-9a974847-1dcf-4987-8c40-e72dbafda1a1 service nova] Releasing lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.utils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3c873-1947-4cbd-9496-8c522aebe6ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9504fdbf-5d05-48d0-ab28-efcb67b37d78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63eca0d-b8e9-4446-a2b5-1adfb52635cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d42245-b7d8-41fe-a969-0b234e6d0e0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:55:51 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:55:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ede9b-fe8c-4a15-989b-80412455911a]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG os_brick.utils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:55:51 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updating existing volume attachment record: b1352f24-0a05-4494-8abe-76a11e92a9c0 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:52 user nova-compute[73458]: WARNING nova.compute.manager [req-a100e409-f34a-47fe-b0b7-0786378da655 req-ef995574-1ccb-4f09-ad0c-e4a947b38ccb service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state building and task_state spawning.
Aug 27 00:55:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:55:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:55:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:55:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:55:54 user nova-compute[73458]: WARNING nova.compute.manager [req-aaeb5f99-a783-4a09-a38a-46f76b1c2bc9 req-63c1ff45-aa2b-47fa-aea5-0f883d221ba6 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state building and task_state spawning.
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097755.0391757, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Resumed (Lifecycle Event)
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance spawned successfully.
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097755.0416286, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Started (Lifecycle Event)
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 27 00:55:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:55:55 user nova-compute[73458]: INFO nova.compute.manager [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Took 7.09 seconds to build instance.
Aug 27 00:55:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-12d42738-6400-4fd3-bb56-d8d14d01b411 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.240s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:55:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:55:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGctUFnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:04 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:04 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:04 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9587254-0267-4269-a02a-3f13c46b6886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:56:04 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a868b50-3174-49bf-acfb-e907c1b4ca2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7] added
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3c744-daab-4e60-af32-ea2b2db0682e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b6c37d-8e4e-4410-9e13-3d693e4588a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGctUFnM {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGctUFnM" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be5244-3502-431e-adaf-83930ebd35e9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bGctUFnM'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e8a08-46f0-45b3-a459-f2c85f406f91]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460cd27-9fad-4c98-b141-6049ea1a8420]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21adf3c1-deb6-41e0-ab56-a6634ca7b271]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260]
Aug 27 00:56:04 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260] successful.
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d80d9d-31a7-4052-8d2c-bfe1bcac29e3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e1d8b-e8f2-4b5d-b9e1-295153de8e27]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)
Aug 27 00:56:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81eed4e-c06b-4600-859f-98940350f849]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:56:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGctUFnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26430333136623336', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430333136623336', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'flavor' on Instance uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:56:05 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:56:05 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:56:05 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:56:05 user nova-compute[73458]:   <serial>a55d6ba0-2534-4e67-8c66-558f0202d4f7</serial>
Aug 27 00:56:05 user nova-compute[73458]: </disk>
Aug 27 00:56:05 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No VIF found with MAC fa:16:3e:c6:bc:dd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:56:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ebab8b49-2977-471c-91c3-322a2e7124b4 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.451s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:07 user nova-compute[73458]: INFO nova.compute.manager [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Detaching volume a55d6ba0-2534-4e67-8c66-558f0202d4f7
Aug 27 00:56:07 user nova-compute[73458]: INFO nova.virt.block_device [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Attempting to driver detach volume a55d6ba0-2534-4e67-8c66-558f0202d4f7 from mountpoint /dev/vdb
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Attempting to detach device vdb from instance a800258d-520b-4e76-90b4-0f7b2c8f3adc from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:56:07 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:56:07 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:56:07 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:56:07 user nova-compute[73458]:   <serial>a55d6ba0-2534-4e67-8c66-558f0202d4f7</serial>
Aug 27 00:56:07 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:56:07 user nova-compute[73458]: </disk>
Aug 27 00:56:07 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:56:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully detached device vdb from instance a800258d-520b-4e76-90b4-0f7b2c8f3adc from the persistent domain config.
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a800258d-520b-4e76-90b4-0f7b2c8f3adc from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:56:07 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:56:07 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:56:07 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:56:07 user nova-compute[73458]:   <serial>a55d6ba0-2534-4e67-8c66-558f0202d4f7</serial>
Aug 27 00:56:07 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:56:07 user nova-compute[73458]: </disk>
Aug 27 00:56:07 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097767.8427796, a800258d-520b-4e76-90b4-0f7b2c8f3adc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:56:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully detached device vdb from instance a800258d-520b-4e76-90b4-0f7b2c8f3adc from the live domain config.
Aug 27 00:56:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGctUFnM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38912cf-1fcd-407a-97fc-4b6563c73fea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59dbdf-aedc-403a-8293-abc8b3abab36]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:07 user nova-compute[73458]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)
Aug 27 00:56:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:07 user nova-compute[73458]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 (non-flash)
Aug 27 00:56:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eae0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc041ed-cbd2-4ff0-bacc-03784d99ae03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f82c100-eaeb-43bd-994a-7358eb130753]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ddc92-b2b3-485a-89e2-79e673fb8762]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:56:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c95499-fc41-4ec8-841a-7ef29387aaea]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0368fd-5150-4334-99bd-c501061db80d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d4c6d-378e-440f-a48b-b66d261e4c3f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260]
Aug 27 00:56:08 user nova-compute[73458]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7, portal: 172.16.0.220,3260] successful.
Aug 27 00:56:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a55d6ba0-2534-4e67-8c66-558f0202d4f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190a0b9-22eb-4616-98e1-c5a010d58f55]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] <== disconnect_volume: return (271ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:56:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'flavor' on Instance uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-795af88b-d28b-4cf6-b5b3-a96dbfff3929 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:56:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:27 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:56:27 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:56:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7172MB free_disk=25.523719787597656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a261c7ca-0d55-492e-8601-d5819b9d8fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:56:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:56:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing instance network info cache due to event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:56:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updated VIF entry in instance network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:56:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-da64b4bf-2356-4bce-80f3-75d74dd403ac req-5786c11c-e39a-4885-89ed-ee00ff111957 service nova] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:56:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:37 user nova-compute[73458]: INFO nova.compute.manager [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Shelving
Aug 27 00:56:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:56:37 user nova-compute[73458]: WARNING nova.compute.manager [req-dfea4f4a-819c-4d58-b33a-fad5e3eb6112 req-759a6625-a840-4667-bb72-1843547608c0 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state active and task_state shelving.
Aug 27 00:56:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance destroyed successfully.
Aug 27 00:56:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Beginning cold snapshot process
Aug 27 00:56:38 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:56:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk /opt/stack/data/nova/instances/snapshots/tmppzeylllh/f55e17435c314cc8be860524fcbcf554 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk /opt/stack/data/nova/instances/snapshots/tmppzeylllh/f55e17435c314cc8be860524fcbcf554" returned: 0 in 0.689s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Snapshot extracted, beginning image upload
Aug 27 00:56:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:56:39 user nova-compute[73458]: WARNING nova.compute.manager [req-a3a9ebbf-af23-4b2a-b9c9-0ecf417b906f req-8b3c6630-86c7-494c-9d22-f48a3a4aa237 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'flavor' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:40 user nova-compute[73458]: INFO nova.compute.manager [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attaching volume 8ecbc422-4625-4655-85e3-2360dbf318a1 to /dev/vdb
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3479ae-a989-4432-8d63-449805cb6e70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa6a6b-add7-4a22-877a-b0664eaec6fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ab2f5-6b9d-4078-87a3-4dc057cdbe10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[926bd79f-cb8d-411e-9a9c-73e81b20010e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:56:40 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:56:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e62e41-6bba-4388-9aaa-62c1ac0236c9]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:40 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating existing volume attachment record: 340eb294-81f3-4320-a993-0db941647aef {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:56:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Snapshot image upload complete
Aug 27 00:56:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:56:41 user nova-compute[73458]: INFO nova.compute.manager [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Shelve offloading
Aug 27 00:56:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance destroyed successfully.
Aug 27 00:56:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:42 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance destroyed successfully.
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'resources' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2BhiUFgHSdo4/YvXrdIeWNxmJCq86bCymbFfKa01U9yO3cnwit6zjH+B4IcyUD3gCYhT5If75KDME6CdpbpKJSVrT6eH5WPgg5+IxCbIr3FvgN/LDnvOhRZbjUOFUyvg==',key_name='tempest-keypair-1066942134',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T00:56:41.030367',shelved_host='user',shelved_image_id='47553cba-ab8e-4f73-9bc1-816e031da83c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG os_vif [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc529fc8d-8b, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:42 user nova-compute[73458]: INFO os_vif [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b')
Aug 27 00:56:42 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Deleting instance files /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee_del
Aug 27 00:56:42 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Deletion of /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee_del complete
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing instance network info cache due to event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:56:42 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Deleted allocations for instance a261c7ca-0d55-492e-8601-d5819b9d8fee
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'numa_topology' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.objects.base [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<a261c7ca-0d55-492e-8601-d5819b9d8fee> lazy-loaded attributes: resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updated VIF entry in instance network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f5fdcf98-9e21-469f-8e27-c3738effc6f7 req-f1497c86-100a-420d-8df9-ac1a76c4ceb6 service nova] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8cf6d7d2-c7ae-40c8-aafc-2f2a2f77472b tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.752s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:56:43 user nova-compute[73458]: INFO nova.compute.claims [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Claim successful on node user
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:56:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:56:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:56:44 user nova-compute[73458]: INFO nova.virt.block_device [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Booting with blank volume at /dev/vda
Aug 27 00:56:44 user nova-compute[73458]: DEBUG nova.policy [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a452f9412de4c8d881d30b02c01d3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3537b33489d84282958ddf05f58ade1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Successfully created port: ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Successfully updated port: ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-changed-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Refreshing instance network info cache due to event network-changed-ef531fea-3dc7-46ee-99e3-c224e729dc9c. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:56:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance network_info: |[{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Refreshing network info cache for port ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updated VIF entry in instance network info cache for port ef531fea-3dc7-46ee-99e3-c224e729dc9c. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6bdf927e-19fc-42a6-82f0-bf8e1f733408 req-1e197ab3-4160-4ee6-9801-a9bb255d7ec5 service nova] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:49 user nova-compute[73458]: DEBUG os_brick.utils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c919c30-b6af-4176-a272-6cabe6300d3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f052532d-4a26-449d-bfb8-a18a26157cd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3162d2-28ca-421c-96d2-4501c04eb2c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b674754d-a230-4013-ba81-141ad40837bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:56:50 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:56:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb4f6af-d7b8-4210-8f20-da2c406461dc]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG os_brick.utils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:50 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating existing volume attachment record: 433d1030-d533-45e5-9907-a790dbacd8b4 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:51 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4512da-fd76-47b8-8136-3b26c2d13f2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:56:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7064ba2-3621-4dcc-89ae-a33e2f9f75d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1] added
Aug 27 00:56:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d205f0-0a05-4a8e-8fd5-ea02463d49ca]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce0f095-4308-4959-8123-65006b1f59ef]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkiEQzMS {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkiEQzMS" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49b3e1-e752-41c1-8dc8-274b0b217284]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UkiEQzMS'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eccef01-6ce5-49ef-9c6d-4480fcfa574c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640495a-98be-4774-8dd1-e8e1b20fa481]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f50e5-955c-4e16-a788-f014e2b10fff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260]
Aug 27 00:56:52 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260] successful.
Aug 27 00:56:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8aadf1-c1ce-454b-b70f-2b4cdc8323b2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ceabbf-3eb7-410d-aea7-4338674586fc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:56:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be391a-b3a6-4e8d-acfd-4c6ea9b6f36b]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:52 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097797.8613255, a261c7ca-0d55-492e-8601-d5819b9d8fee => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:56:52 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Stopped (Lifecycle Event)
Aug 27 00:56:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-06f5bd4a-6c2d-4d35-ba87-3e1a9b4f7f0f None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23233636466326337', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233636466326337', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'flavor' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:56:53 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:56:53 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:56:53 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:56:53 user nova-compute[73458]:   <serial>8ecbc422-4625-4655-85e3-2360dbf318a1</serial>
Aug 27 00:56:53 user nova-compute[73458]: </disk>
Aug 27 00:56:53 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No VIF found with MAC fa:16:3e:d8:e5:bd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:56:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6edd22a2-139d-4256-901d-0f129c6bec2e tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.820s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:54 user nova-compute[73458]: INFO nova.compute.manager [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Rescuing
Aug 27 00:56:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:56:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:56:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:56:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:56:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:56:55 user nova-compute[73458]: WARNING nova.compute.manager [req-afaea4a8-451a-4b94-97ef-6b3d470f7311 req-024cfba8-02b6-4b58-b549-d035163dee57 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state rescuing.
Aug 27 00:56:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance destroyed successfully.
Aug 27 00:56:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attempting a stable device rescue
Aug 27 00:56:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 00:56:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Creating image(s)
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "684ba802c77c3ae1d222e6511868018eca6c9f31" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "684ba802c77c3ae1d222e6511868018eca6c9f31" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG nova.virt.images [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] 6a009fd7-b7de-47c1-bee7-8e431bb7cc5d was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.part /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:56:57 user nova-compute[73458]: WARNING nova.compute.manager [req-9d5c2b98-b328-4e16-b3b5-7103d2a53c26 req-4f97642c-04f6-4561-8410-3907b3b44e9e service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state rescuing.
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.part /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.converted" returned: 0 in 0.415s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "684ba802c77c3ae1d222e6511868018eca6c9f31" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.809s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "684ba802c77c3ae1d222e6511868018eca6c9f31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "684ba802c77c3ae1d222e6511868018eca6c9f31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31 --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31,backing_fmt=raw /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31,backing_fmt=raw /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue" returned: 0 in 0.050s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "684ba802c77c3ae1d222e6511868018eca6c9f31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'migration_context' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Object Instance<f4f1df39-5fd2-4ede-a842-490239d576fb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start _get_guest_xml network_info=[{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "vif_mac": "fa:16:3e:d8:e5:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6a009fd7-b7de-47c1-bee7-8e431bb7cc5d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f4f1df39-5fd2-4ede-a842-490239d576fb', 'attached_at': '', 'detached_at': '', 'volume_id': '8ecbc422-4625-4655-85e3-2360dbf318a1', 'serial': '8ecbc422-4625-4655-85e3-2360dbf318a1'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '340eb294-81f3-4320-a993-0db941647aef', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'resources' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Object Instance<f4f1df39-5fd2-4ede-a842-490239d576fb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'numa_topology' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Object Instance<f4f1df39-5fd2-4ede-a842-490239d576fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:58 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:56:58 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Object Instance<f4f1df39-5fd2-4ede-a842-490239d576fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:56:58 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:58 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:56:58 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdf4639-de15-44eb-b8f0-1aac5cccdec3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UkiEQzMS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 00:56:58 user nova-compute[73458]: node.name = iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1
Aug 27 00:56:58 user nova-compute[73458]: node.tpgt = -1
Aug 27 00:56:58 user nova-compute[73458]: node.startup = automatic
Aug 27 00:56:58 user nova-compute[73458]: node.leading_login = No
Aug 27 00:56:58 user nova-compute[73458]: iface.iscsi_ifacename = default
Aug 27 00:56:58 user nova-compute[73458]: iface.net_ifacename = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.ipaddress = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.prefix_len = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.hwaddress = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.transport_name = tcp
Aug 27 00:56:58 user nova-compute[73458]: iface.initiatorname = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.vlan_id = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.vlan_priority = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.vlan_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.iface_num = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.mtu = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.port = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.bootproto = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.subnet_mask = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.gateway = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_alt_client_id = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_dns = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_learn_iqn = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_vendor_id_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_vendor_id = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.dhcp_slp_da = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.fragmentation = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.gratuitous_arp = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.incoming_forwarding = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.tos_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.tos = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.ttl = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.delayed_ack = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.tcp_nagle = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.tcp_wsf_state = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.tcp_wsf = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.tcp_timer_scale = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.tcp_timestamp = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.redirect = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.def_task_mgmt_timeout = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.header_digest = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.data_digest = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.immediate_data = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.initial_r2t = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.data_seq_inorder = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.data_pdu_inorder = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.erl = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.max_receive_data_len = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.first_burst_len = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.max_outstanding_r2t = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.max_burst_len = 0
Aug 27 00:56:58 user nova-compute[73458]: iface.chap_auth = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.bidi_chap = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.strict_login_compliance = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.discovery_auth = <empty>
Aug 27 00:56:58 user nova-compute[73458]: iface.discovery_logout = <empty>
Aug 27 00:56:58 user nova-compute[73458]: node.discovery_address = <empty>
Aug 27 00:56:58 user nova-compute[73458]: node.discovery_port = 0
Aug 27 00:56:58 user nova-compute[73458]: node.discovery_type = static
Aug 27 00:56:58 user nova-compute[73458]: node.session.initial_cmdsn = 0
Aug 27 00:56:58 user nova-compute[73458]: node.session.initial_login_retry_max = 8
Aug 27 00:56:58 user nova-compute[73458]: node.session.xmit_thread_priority = -20
Aug 27 00:56:58 user nova-compute[73458]: node.session.cmds_max = 128
Aug 27 00:56:58 user nova-compute[73458]: node.session.queue_depth = 32
Aug 27 00:56:58 user nova-compute[73458]: node.session.nr_sessions = 1
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.authmethod = CHAP
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.username = UkiEQzMS
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.password = ***
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.username_in = <empty>
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.password_in = <empty>
Aug 27 00:56:58 user nova-compute[73458]: node.session.auth.chap_algs = MD5
Aug 27 00:56:58 user nova-compute[73458]: node.session.timeo.replacement_timeout = 120
Aug 27 00:56:58 user nova-compute[73458]: node.session.err_timeo.abort_timeout = 15
Aug 27 00:56:58 user nova-compute[73458]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 00:56:58 user nova-compute[73458]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 00:56:58 user nova-compute[73458]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.FastAbort = Yes
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.InitialR2T = No
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.ImmediateData = Yes
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.MaxConnections = 1
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 00:56:58 user nova-compute[73458]: node.session.iscsi.ERL = 0
Aug 27 00:56:58 user nova-compute[73458]: node.session.scan = manual
Aug 27 00:56:58 user nova-compute[73458]: node.session.reopen_max = 0
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].address = 172.16.0.220
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].port = 3260
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].startup = manual
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].tcp.window_size = 524288
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].tcp.type_of_service = 0
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].timeo.logout_timeout = 15
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].timeo.login_timeout = 15
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].timeo.auth_timeout = 45
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.DataDigest = None
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.IFMarker = No
Aug 27 00:56:58 user nova-compute[73458]: node.conn[0].iscsi.OFMarker = No
Aug 27 00:56:58 user nova-compute[73458]: # END RECORD
Aug 27 00:56:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[648451fe-307e-4dcc-9713-1ce116bdc442]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d7ee7-bb26-48de-80ce-1dc2095135c1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkiEQzMS {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UkiEQzMS" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88caa73-fab9-41a1-a511-f895a4caa0f8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UkiEQzMS'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae068c8-8210-4e7e-8b9b-157bcde72d19]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e7be16-9e07-457e-8fbd-834915bc362d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:58 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:56:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:56:58 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:56:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] HCTL ('34', '0', '0', 0) found on session 24 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bef2a-d97b-43fc-8acd-32e7c60c2260]: (4, ('0 0 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Searching for a device in session 24 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '23233636466326337', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233636466326337', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1962945541',display_name='tempest-ServerStableDeviceRescueTest-server-1962945541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1962945541',id=14,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgIu1wx5QmNGPoFJWle5oXsGIeKQQNYuSUKqf2HpCBce87wL/1qbGhHE/sHseHDQ1imPghaGIGNUpXpn45hRPDv1vZLB3iiCgcx29QKYy1SwgcVT6KOPoEJFr2cKAUcpg==',key_name='tempest-keypair-1397530717',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc97d2501a284ec79d261c526265f32b',ramdisk_id='',reservation_id='r-2djw89le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-270201702',owner_user_name='tempest-ServerStableDeviceRescueTest-270201702-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64448af42ce44819a5ebc11f968d099e',uuid=f4f1df39-5fd2-4ede-a842-490239d576fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "vif_mac": "fa:16:3e:d8:e5:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converting VIF {"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "vif_mac": "fa:16:3e:d8:e5:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'pci_devices' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.objects.base [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Object Instance<f4f1df39-5fd2-4ede-a842-490239d576fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:56:58 user nova-compute[73458]:   <uuid>f4f1df39-5fd2-4ede-a842-490239d576fb</uuid>
Aug 27 00:56:58 user nova-compute[73458]:   <name>instance-0000000e</name>
Aug 27 00:56:58 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:56:58 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:56:58 user nova-compute[73458]:   <metadata>
Aug 27 00:56:58 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:56:58 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1962945541</nova:name>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:56:58</nova:creationTime>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:56:58 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:56:58 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:owner>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:user uuid="64448af42ce44819a5ebc11f968d099e">tempest-ServerStableDeviceRescueTest-270201702-project-member</nova:user>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:project uuid="bc97d2501a284ec79d261c526265f32b">tempest-ServerStableDeviceRescueTest-270201702</nova:project>
Aug 27 00:56:58 user nova-compute[73458]:       </nova:owner>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:56:58 user nova-compute[73458]:       <nova:ports>
Aug 27 00:56:58 user nova-compute[73458]:         <nova:port uuid="59fe0e5c-9ae7-445b-b379-fbf924be540d">
Aug 27 00:56:58 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:56:58 user nova-compute[73458]:         </nova:port>
Aug 27 00:56:58 user nova-compute[73458]:       </nova:ports>
Aug 27 00:56:58 user nova-compute[73458]:     </nova:instance>
Aug 27 00:56:58 user nova-compute[73458]:   </metadata>
Aug 27 00:56:58 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:56:58 user nova-compute[73458]:     <system>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="serial">f4f1df39-5fd2-4ede-a842-490239d576fb</entry>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="uuid">f4f1df39-5fd2-4ede-a842-490239d576fb</entry>
Aug 27 00:56:58 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:56:58 user nova-compute[73458]:     </system>
Aug 27 00:56:58 user nova-compute[73458]:   </sysinfo>
Aug 27 00:56:58 user nova-compute[73458]:   <os>
Aug 27 00:56:58 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:56:58 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:56:58 user nova-compute[73458]:   </os>
Aug 27 00:56:58 user nova-compute[73458]:   <features>
Aug 27 00:56:58 user nova-compute[73458]:     <acpi/>
Aug 27 00:56:58 user nova-compute[73458]:     <apic/>
Aug 27 00:56:58 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:56:58 user nova-compute[73458]:   </features>
Aug 27 00:56:58 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:56:58 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:56:58 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:56:58 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:56:58 user nova-compute[73458]:   </clock>
Aug 27 00:56:58 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:56:58 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:56:58 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:56:58 user nova-compute[73458]:   </cpu>
Aug 27 00:56:58 user nova-compute[73458]:   <devices>
Aug 27 00:56:58 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:56:58 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:56:58 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk"/>
Aug 27 00:56:58 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:56:58 user nova-compute[73458]:     </disk>
Aug 27 00:56:58 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:56:58 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:56:58 user nova-compute[73458]:       <source dev="/dev/sdc"/>
Aug 27 00:56:58 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:56:58 user nova-compute[73458]:       <serial>8ecbc422-4625-4655-85e3-2360dbf318a1</serial>
Aug 27 00:56:58 user nova-compute[73458]:     </disk>
Aug 27 00:56:58 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:56:58 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:56:58 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue"/>
Aug 27 00:56:58 user nova-compute[73458]:       <target dev="vdc" bus="virtio"/>
Aug 27 00:56:58 user nova-compute[73458]:       <boot order="1"/>
Aug 27 00:56:58 user nova-compute[73458]:     </disk>
Aug 27 00:56:58 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:56:58 user nova-compute[73458]:       <mac address="fa:16:3e:d8:e5:bd"/>
Aug 27 00:56:58 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:56:58 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:56:58 user nova-compute[73458]:       <target dev="tap59fe0e5c-9a"/>
Aug 27 00:56:58 user nova-compute[73458]:     </interface>
Aug 27 00:56:58 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:56:58 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/console.log" append="off"/>
Aug 27 00:56:58 user nova-compute[73458]:     </serial>
Aug 27 00:56:58 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:56:58 user nova-compute[73458]:     <video>
Aug 27 00:56:58 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:56:58 user nova-compute[73458]:     </video>
Aug 27 00:56:58 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:56:58 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:56:58 user nova-compute[73458]:     </rng>
Aug 27 00:56:58 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:56:58 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:56:58 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:56:58 user nova-compute[73458]:     </memballoon>
Aug 27 00:56:58 user nova-compute[73458]:   </devices>
Aug 27 00:56:58 user nova-compute[73458]: </domain>
Aug 27 00:56:58 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:56:58 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance destroyed successfully.
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] No VIF found with MAC fa:16:3e:d8:e5:bd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:56:58 user nova-compute[73458]: INFO nova.compute.claims [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Claim successful on node user
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:56:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.policy [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38cdf950732a4f6581779ce01d3eea2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a956bb1b3c495b8d65db34fb63349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:56:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Creating image(s)
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "/opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "/opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:56:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.245s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk 1073741824" returned: 0 in 0.082s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:00 user nova-compute[73458]: WARNING nova.compute.manager [req-3c792f87-a1ec-4ab9-b8cc-efc87eb46ff4 req-b13d57e4-e340-4b5c-8af4-801d825cf90f service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state rescuing.
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Successfully created port: 258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.232s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Cannot resize image /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Ensure instance console log exists: /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Successfully updated port: 258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquired lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-changed-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Refreshing instance network info cache due to event network-changed-258691df-7086-4165-a6ce-caff4f3565a2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] Acquiring lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Updating instance_info_cache with network_info: [{"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Releasing lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Instance network_info: |[{"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] Acquired lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Refreshing network info cache for port 258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Start _get_guest_xml network_info=[{"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:57:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992638498',display_name='tempest-VolumesAdminNegativeTest-server-992638498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992638498',id=22,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-7vxac9zk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:00Z,user_data=None,user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'pci_devices' on Instance uuid ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:57:02 user nova-compute[73458]:   <uuid>ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c</uuid>
Aug 27 00:57:02 user nova-compute[73458]:   <name>instance-00000016</name>
Aug 27 00:57:02 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:57:02 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:57:02 user nova-compute[73458]:   <metadata>
Aug 27 00:57:02 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:57:02 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:name>tempest-VolumesAdminNegativeTest-server-992638498</nova:name>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:57:01</nova:creationTime>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:57:02 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:57:02 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:owner>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:user uuid="38cdf950732a4f6581779ce01d3eea2c">tempest-VolumesAdminNegativeTest-405879464-project-member</nova:user>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:project uuid="69a956bb1b3c495b8d65db34fb63349f">tempest-VolumesAdminNegativeTest-405879464</nova:project>
Aug 27 00:57:02 user nova-compute[73458]:       </nova:owner>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:57:02 user nova-compute[73458]:       <nova:ports>
Aug 27 00:57:02 user nova-compute[73458]:         <nova:port uuid="258691df-7086-4165-a6ce-caff4f3565a2">
Aug 27 00:57:02 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 00:57:02 user nova-compute[73458]:         </nova:port>
Aug 27 00:57:02 user nova-compute[73458]:       </nova:ports>
Aug 27 00:57:02 user nova-compute[73458]:     </nova:instance>
Aug 27 00:57:02 user nova-compute[73458]:   </metadata>
Aug 27 00:57:02 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:57:02 user nova-compute[73458]:     <system>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="serial">ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c</entry>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="uuid">ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c</entry>
Aug 27 00:57:02 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:57:02 user nova-compute[73458]:     </system>
Aug 27 00:57:02 user nova-compute[73458]:   </sysinfo>
Aug 27 00:57:02 user nova-compute[73458]:   <os>
Aug 27 00:57:02 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:57:02 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:57:02 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:57:02 user nova-compute[73458]:   </os>
Aug 27 00:57:02 user nova-compute[73458]:   <features>
Aug 27 00:57:02 user nova-compute[73458]:     <acpi/>
Aug 27 00:57:02 user nova-compute[73458]:     <apic/>
Aug 27 00:57:02 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:57:02 user nova-compute[73458]:   </features>
Aug 27 00:57:02 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:57:02 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:57:02 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:57:02 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:57:02 user nova-compute[73458]:   </clock>
Aug 27 00:57:02 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:57:02 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:57:02 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:57:02 user nova-compute[73458]:   </cpu>
Aug 27 00:57:02 user nova-compute[73458]:   <devices>
Aug 27 00:57:02 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:57:02 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:57:02 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk"/>
Aug 27 00:57:02 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:57:02 user nova-compute[73458]:     </disk>
Aug 27 00:57:02 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:57:02 user nova-compute[73458]:       <mac address="fa:16:3e:f9:6f:a3"/>
Aug 27 00:57:02 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:02 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:57:02 user nova-compute[73458]:       <target dev="tap258691df-70"/>
Aug 27 00:57:02 user nova-compute[73458]:     </interface>
Aug 27 00:57:02 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:57:02 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/console.log" append="off"/>
Aug 27 00:57:02 user nova-compute[73458]:     </serial>
Aug 27 00:57:02 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:57:02 user nova-compute[73458]:     <video>
Aug 27 00:57:02 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:02 user nova-compute[73458]:     </video>
Aug 27 00:57:02 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:57:02 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:57:02 user nova-compute[73458]:     </rng>
Aug 27 00:57:02 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:57:02 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:57:02 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:57:02 user nova-compute[73458]:     </memballoon>
Aug 27 00:57:02 user nova-compute[73458]:   </devices>
Aug 27 00:57:02 user nova-compute[73458]: </domain>
Aug 27 00:57:02 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992638498',display_name='tempest-VolumesAdminNegativeTest-server-992638498',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992638498',id=22,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-7vxac9zk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:00Z,user_data=None,user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_vif [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap258691df-70, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap258691df-70, col_values=(('external_ids', {'iface-id': '258691df-7086-4165-a6ce-caff4f3565a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:6f:a3', 'vm-uuid': 'ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:02 user nova-compute[73458]: INFO os_vif [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70')
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] No VIF found with MAC fa:16:3e:f9:6f:a3, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for f4f1df39-5fd2-4ede-a842-490239d576fb due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097822.247818, f4f1df39-5fd2-4ede-a842-490239d576fb => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Resumed (Lifecycle Event)
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-08c25d57-3cae-412e-9f13-92fec6c04c79 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097822.2495003, f4f1df39-5fd2-4ede-a842-490239d576fb => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Started (Lifecycle Event)
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:02 user nova-compute[73458]: WARNING nova.compute.manager [req-ff97f47d-6c54-4da8-b8f5-ac32391ee854 req-3943eae0-b1a0-4000-b899-56545610d039 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state rescuing.
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Updated VIF entry in instance network info cache for port 258691df-7086-4165-a6ce-caff4f3565a2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Updating instance_info_cache with network_info: [{"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b16fc208-79c8-4f26-9918-2c65d6e31731 req-ced6f011-2e35-48f7-955c-ead39dc3cc72 service nova] Releasing lock "refresh_cache-ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:57:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Creating image(s)
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Ensure instance console log exists: /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start _get_guest_xml network_info=[{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85e602b0-6c12-4d09-825c-ececd08c663a', 'attached_at': '', 'detached_at': '', 'volume_id': '8715b73e-094f-4742-a399-65c61abcb6c8', 'serial': '8715b73e-094f-4742-a399-65c61abcb6c8'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '433d1030-d533-45e5-9907-a790dbacd8b4', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:57:02 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:02 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:02 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:02 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:02 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9416b5c9-abae-4968-ab9d-1f7aa49ad6b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:57:02 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d60ea64-54c6-47a5-b0aa-4fbf16c6b2f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8] added
Aug 27 00:57:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[409854d3-2de2-4f1b-ab1b-4a158151017d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9442dcd8-335a-4135-a69e-906b781333fd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwDUqrSt {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwDUqrSt" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[154e5164-7c4f-4e77-a9b4-08932b98ffb3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwDUqrSt'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2d36d-cd0d-42db-bb97-1b530d946682]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db42323e-8ea7-4eab-ae19-69b29c5a435f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:02 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:02 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[daee8266-48aa-499f-9817-c240fe237b52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260]
Aug 27 00:57:03 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260] successful.
Aug 27 00:57:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2d329-f1de-4557-b2f1-64be755d3637]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e07c0-8d8c-4cf9-a2a4-aba4304f81ee]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465efb5-b438-4356-88a2-1365bb34ea6f]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] No waiting events found dispatching network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:03 user nova-compute[73458]: WARNING nova.compute.manager [req-a7a4e846-8510-43e1-89b7-fe9bf913ac74 req-a36e9334-5b1b-4a39-8dd3-cde1ffab2423 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received unexpected event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 for instance with vm_state building and task_state spawning.
Aug 27 00:57:04 user nova-compute[73458]: INFO nova.compute.manager [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Rescuing
Aug 27 00:57:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23037633865653435', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037633865653435', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1715805118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1715805118',id=21,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-pt4850kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:56:44Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=85e602b0-6c12-4d09-825c-ececd08c663a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:57:04 user nova-compute[73458]:   <uuid>85e602b0-6c12-4d09-825c-ececd08c663a</uuid>
Aug 27 00:57:04 user nova-compute[73458]:   <name>instance-00000015</name>
Aug 27 00:57:04 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:57:04 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:57:04 user nova-compute[73458]:   <metadata>
Aug 27 00:57:04 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:57:04 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1715805118</nova:name>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:57:02</nova:creationTime>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:57:04 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:57:04 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:owner>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 00:57:04 user nova-compute[73458]:       </nova:owner>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:57:04 user nova-compute[73458]:       <nova:ports>
Aug 27 00:57:04 user nova-compute[73458]:         <nova:port uuid="ef531fea-3dc7-46ee-99e3-c224e729dc9c">
Aug 27 00:57:04 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 00:57:04 user nova-compute[73458]:         </nova:port>
Aug 27 00:57:04 user nova-compute[73458]:       </nova:ports>
Aug 27 00:57:04 user nova-compute[73458]:     </nova:instance>
Aug 27 00:57:04 user nova-compute[73458]:   </metadata>
Aug 27 00:57:04 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:57:04 user nova-compute[73458]:     <system>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="serial">85e602b0-6c12-4d09-825c-ececd08c663a</entry>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="uuid">85e602b0-6c12-4d09-825c-ececd08c663a</entry>
Aug 27 00:57:04 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:57:04 user nova-compute[73458]:     </system>
Aug 27 00:57:04 user nova-compute[73458]:   </sysinfo>
Aug 27 00:57:04 user nova-compute[73458]:   <os>
Aug 27 00:57:04 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:57:04 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:57:04 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:57:04 user nova-compute[73458]:   </os>
Aug 27 00:57:04 user nova-compute[73458]:   <features>
Aug 27 00:57:04 user nova-compute[73458]:     <acpi/>
Aug 27 00:57:04 user nova-compute[73458]:     <apic/>
Aug 27 00:57:04 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:57:04 user nova-compute[73458]:   </features>
Aug 27 00:57:04 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:57:04 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:57:04 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:57:04 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:57:04 user nova-compute[73458]:   </clock>
Aug 27 00:57:04 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:57:04 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:57:04 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:57:04 user nova-compute[73458]:   </cpu>
Aug 27 00:57:04 user nova-compute[73458]:   <devices>
Aug 27 00:57:04 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:57:04 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:57:04 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 00:57:04 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:57:04 user nova-compute[73458]:       <serial>8715b73e-094f-4742-a399-65c61abcb6c8</serial>
Aug 27 00:57:04 user nova-compute[73458]:     </disk>
Aug 27 00:57:04 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:57:04 user nova-compute[73458]:       <mac address="fa:16:3e:78:ed:e7"/>
Aug 27 00:57:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:04 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:57:04 user nova-compute[73458]:       <target dev="tapef531fea-3d"/>
Aug 27 00:57:04 user nova-compute[73458]:     </interface>
Aug 27 00:57:04 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:57:04 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/console.log" append="off"/>
Aug 27 00:57:04 user nova-compute[73458]:     </serial>
Aug 27 00:57:04 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:57:04 user nova-compute[73458]:     <video>
Aug 27 00:57:04 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:04 user nova-compute[73458]:     </video>
Aug 27 00:57:04 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:57:04 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:57:04 user nova-compute[73458]:     </rng>
Aug 27 00:57:04 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:57:04 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:57:04 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:57:04 user nova-compute[73458]:     </memballoon>
Aug 27 00:57:04 user nova-compute[73458]:   </devices>
Aug 27 00:57:04 user nova-compute[73458]: </domain>
Aug 27 00:57:04 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1715805118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1715805118',id=21,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-pt4850kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:56:44Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=85e602b0-6c12-4d09-825c-ececd08c663a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG os_vif [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef531fea-3d, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef531fea-3d, col_values=(('external_ids', {'iface-id': 'ef531fea-3dc7-46ee-99e3-c224e729dc9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:ed:e7', 'vm-uuid': '85e602b0-6c12-4d09-825c-ececd08c663a'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:04 user nova-compute[73458]: INFO os_vif [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d')
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:78:ed:e7, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:05 user nova-compute[73458]: WARNING nova.compute.manager [req-cb5e7777-8fae-4b96-b578-47ebb90be76f req-34e7125d-2b29-4058-b64a-786e8f8e41a7 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state active and task_state rescuing.
Aug 27 00:57:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] No waiting events found dispatching network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:05 user nova-compute[73458]: WARNING nova.compute.manager [req-e74c92df-3744-426a-85b7-5d1cbb25e339 req-2e5758ab-d616-4d4d-86ce-d3a294c08928 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received unexpected event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 for instance with vm_state building and task_state spawning.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097826.439857, ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] VM Resumed (Lifecycle Event)
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Instance spawned successfully.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097826.4410064, ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] VM Started (Lifecycle Event)
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance destroyed successfully.
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Attempting rescue
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Took 7.03 seconds to spawn the instance on the hypervisor.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Creating image(s)
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'trusted_certs' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:06 user nova-compute[73458]: INFO nova.compute.manager [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Took 7.97 seconds to build instance.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-82829deb-992e-43f9-8058-fd3e1eb04400 tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.081s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:06 user nova-compute[73458]: WARNING nova.compute.manager [req-c0c1f874-0c60-42d1-8b88-cc642ccd185e req-fd10f0ac-dd29-43bb-8481-6802cbab2c1d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state building and task_state spawning.
Aug 27 00:57:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.307s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue" returned: 0 in 0.082s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'migration_context' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<c4b43432-4735-496d-a9e9-79a264633d35> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start _get_guest_xml network_info=[{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b6:1e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<c4b43432-4735-496d-a9e9-79a264633d35> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'numa_topology' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<c4b43432-4735-496d-a9e9-79a264633d35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:57:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<c4b43432-4735-496d-a9e9-79a264633d35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-509786178',display_name='tempest-ServerRescueNegativeTestJSON-server-509786178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-509786178',id=19,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:55:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-gd2zn0az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:22Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=c4b43432-4735-496d-a9e9-79a264633d35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b6:1e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b6:1e:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<c4b43432-4735-496d-a9e9-79a264633d35> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:57:07 user nova-compute[73458]:   <uuid>c4b43432-4735-496d-a9e9-79a264633d35</uuid>
Aug 27 00:57:07 user nova-compute[73458]:   <name>instance-00000013</name>
Aug 27 00:57:07 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:57:07 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:57:07 user nova-compute[73458]:   <metadata>
Aug 27 00:57:07 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:57:07 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-509786178</nova:name>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:57:07</nova:creationTime>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:57:07 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:57:07 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:owner>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 00:57:07 user nova-compute[73458]:       </nova:owner>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:57:07 user nova-compute[73458]:       <nova:ports>
Aug 27 00:57:07 user nova-compute[73458]:         <nova:port uuid="ce905a94-63c3-4499-a048-5592b852d701">
Aug 27 00:57:07 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 00:57:07 user nova-compute[73458]:         </nova:port>
Aug 27 00:57:07 user nova-compute[73458]:       </nova:ports>
Aug 27 00:57:07 user nova-compute[73458]:     </nova:instance>
Aug 27 00:57:07 user nova-compute[73458]:   </metadata>
Aug 27 00:57:07 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:57:07 user nova-compute[73458]:     <system>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="serial">c4b43432-4735-496d-a9e9-79a264633d35</entry>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="uuid">c4b43432-4735-496d-a9e9-79a264633d35</entry>
Aug 27 00:57:07 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:57:07 user nova-compute[73458]:     </system>
Aug 27 00:57:07 user nova-compute[73458]:   </sysinfo>
Aug 27 00:57:07 user nova-compute[73458]:   <os>
Aug 27 00:57:07 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:57:07 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:57:07 user nova-compute[73458]:   </os>
Aug 27 00:57:07 user nova-compute[73458]:   <features>
Aug 27 00:57:07 user nova-compute[73458]:     <acpi/>
Aug 27 00:57:07 user nova-compute[73458]:     <apic/>
Aug 27 00:57:07 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:57:07 user nova-compute[73458]:   </features>
Aug 27 00:57:07 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:57:07 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:57:07 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:57:07 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:57:07 user nova-compute[73458]:   </clock>
Aug 27 00:57:07 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:57:07 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:57:07 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:57:07 user nova-compute[73458]:   </cpu>
Aug 27 00:57:07 user nova-compute[73458]:   <devices>
Aug 27 00:57:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:57:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:57:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue"/>
Aug 27 00:57:07 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:57:07 user nova-compute[73458]:     </disk>
Aug 27 00:57:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:57:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:57:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk"/>
Aug 27 00:57:07 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:57:07 user nova-compute[73458]:     </disk>
Aug 27 00:57:07 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:57:07 user nova-compute[73458]:       <mac address="fa:16:3e:b6:1e:93"/>
Aug 27 00:57:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:07 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:57:07 user nova-compute[73458]:       <target dev="tapce905a94-63"/>
Aug 27 00:57:07 user nova-compute[73458]:     </interface>
Aug 27 00:57:07 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:57:07 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/console.log" append="off"/>
Aug 27 00:57:07 user nova-compute[73458]:     </serial>
Aug 27 00:57:07 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:57:07 user nova-compute[73458]:     <video>
Aug 27 00:57:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:57:07 user nova-compute[73458]:     </video>
Aug 27 00:57:07 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:57:07 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:57:07 user nova-compute[73458]:     </rng>
Aug 27 00:57:07 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:57:07 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:57:07 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:57:07 user nova-compute[73458]:     </memballoon>
Aug 27 00:57:07 user nova-compute[73458]:   </devices>
Aug 27 00:57:07 user nova-compute[73458]: </domain>
Aug 27 00:57:07 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:57:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance destroyed successfully.
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:b6:1e:93, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:07 user nova-compute[73458]: WARNING nova.compute.manager [req-03a7562a-4546-4fcd-9d9b-2d5b918d5192 req-884761e9-649f-4131-8e20-680fa0f2672e service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state active and task_state rescuing.
Aug 27 00:57:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:09 user nova-compute[73458]: WARNING nova.compute.manager [req-1cef61a1-df76-4e84-8f1e-357bcbccd134 req-9d5a9cf2-3127-472c-896f-e86fc0caf9f7 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state building and task_state spawning.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097829.26797, 85e602b0-6c12-4d09-825c-ececd08c663a => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Resumed (Lifecycle Event)
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance spawned successfully.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097829.2749698, 85e602b0-6c12-4d09-825c-ececd08c663a => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Started (Lifecycle Event)
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:09 user nova-compute[73458]: INFO nova.compute.manager [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Took 25.94 seconds to build instance.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b8e6d9ab-86ac-423d-b3e6-752420720276 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.133s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:09 user nova-compute[73458]: WARNING nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state active and task_state rescuing.
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:09 user nova-compute[73458]: WARNING nova.compute.manager [req-2fa7133a-4310-486d-9a36-1f7e57ec8b6b req-eb7c0f34-3800-4808-9842-dae63aab090c service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state active and task_state rescuing.
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for c4b43432-4735-496d-a9e9-79a264633d35 due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097831.4597158, c4b43432-4735-496d-a9e9-79a264633d35 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] VM Resumed (Lifecycle Event)
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e7725124-137a-459f-9ccc-bf838b8da92f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097831.4611034, c4b43432-4735-496d-a9e9-79a264633d35 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] VM Started (Lifecycle Event)
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:57:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:24 user nova-compute[73458]: INFO nova.compute.manager [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Terminating instance
Aug 27 00:57:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-75245f1c-e348-4b21-9700-e4b818f711d9 req-545bf7a2-a38c-4cb5-bb76-2f7f801e71b8 service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-unplugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Instance destroyed successfully.
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.objects.instance [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lazy-loading 'resources' on Instance uuid 014595b9-5cb2-4a12-a96c-b57ee091c8ed {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-193534920',display_name='tempest-ServerActionsTestOtherB-server-193534920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-193534920',id=3,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsNF1IQq48nFD9EJlkhlRpqjNXBh87RFMxOaDyJM3GHeCog6Jz3Ao/jn6o5uvtJbDvwMJjI+CahxGKwFxBYCafzIonRDSU+eYXSOqArlZSOW/grsyNDPjVglNvCa0TSsw==',key_name='tempest-keypair-976541964',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:54:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='580bff8187b74188bf3d77bb1413ba5d',ramdisk_id='',reservation_id='r-6wiiw48w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1527688410',owner_user_name='tempest-ServerActionsTestOtherB-1527688410-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:54:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01ccff6ef49a4362a6576ccf9cbbf552',uuid=014595b9-5cb2-4a12-a96c-b57ee091c8ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converting VIF {"id": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "address": "fa:16:3e:e4:e1:1e", "network": {"id": "97a00233-d43d-47bf-b335-249ec8e5b2d4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1312501360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "580bff8187b74188bf3d77bb1413ba5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4a1c5ef-9f", "ovs_interfaceid": "f4a1c5ef-9fa2-4b59-98a2-1b220f512442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_vif [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4a1c5ef-9f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:57:25 user nova-compute[73458]: INFO os_vif [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:e1:1e,bridge_name='br-int',has_traffic_filtering=True,id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442,network=Network(97a00233-d43d-47bf-b335-249ec8e5b2d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4a1c5ef-9f')
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVmybSO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:25 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fef37e-4872-4a17-87f3-fe8a38d36cba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9633a982-9dba-4b44-b86c-9aa907b211a5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:25 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7859a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd9184d-5f84-4b9e-ab09-0a8f3daca37b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f9b36-0f08-4bcc-90f4-e116c6747e67]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f77ea-4aad-480a-9eb3-09bfed9171cd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c523fda-7937-4b89-a69f-30cf81700248]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c743f0a-a2f3-4fdf-a904-100a317c97c6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be1eabd-8d00-438e-a725-b6d06a506758]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260]
Aug 27 00:57:26 user nova-compute[73458]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633, portal: 172.16.0.220,3260] successful.
Aug 27 00:57:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e6cde00-d755-4505-950f-29c7eff8f633 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f97f7-7354-472f-b041-fd90bd06fc3e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] <== disconnect_volume: return (382ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:57:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Deleting instance files /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_del
Aug 27 00:57:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Deletion of /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed_del complete
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/014595b9-5cb2-4a12-a96c-b57ee091c8ed/disk
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:26 user nova-compute[73458]: INFO nova.compute.manager [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] Acquiring lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] No waiting events found dispatching network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:27 user nova-compute[73458]: WARNING nova.compute.manager [req-b00fc5eb-de9f-4556-82d8-84ae060f59c2 req-3463b66d-2d7b-4850-a994-666d6edecd3c service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received unexpected event network-vif-plugged-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 for instance with vm_state active and task_state deleting.
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:27 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Took 1.15 seconds to deallocate network for instance.
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-5759cd7d-fcc5-49a6-8dc7-8b6235778077 req-7415eef0-d5ea-4b67-93dc-5db539084d5d service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Received event network-vif-deleted-f4a1c5ef-9fa2-4b59-98a2-1b220f512442 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:27 user nova-compute[73458]: INFO nova.compute.manager [req-5759cd7d-fcc5-49a6-8dc7-8b6235778077 req-7415eef0-d5ea-4b67-93dc-5db539084d5d service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Neutron deleted interface f4a1c5ef-9fa2-4b59-98a2-1b220f512442; detaching it from the instance and deleting it from the info cache
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.network.neutron [req-5759cd7d-fcc5-49a6-8dc7-8b6235778077 req-7415eef0-d5ea-4b67-93dc-5db539084d5d service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-5759cd7d-fcc5-49a6-8dc7-8b6235778077 req-7415eef0-d5ea-4b67-93dc-5db539084d5d service nova] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Detach interface failed, port_id=f4a1c5ef-9fa2-4b59-98a2-1b220f512442, reason: Instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: INFO nova.compute.manager [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Took 1.14 seconds to detach 1 volumes for instance.
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:28 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:29 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Deleted allocations for instance 014595b9-5cb2-4a12-a96c-b57ee091c8ed
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-138f1010-369a-4b6b-9cd6-773e42561db1 tempest-ServerActionsTestOtherB-1527688410 tempest-ServerActionsTestOtherB-1527688410-project-member] Lock "014595b9-5cb2-4a12-a96c-b57ee091c8ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.841s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:29 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:29 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7260MB free_disk=25.36634063720703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:29 user nova-compute[73458]: INFO nova.compute.manager [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Terminating instance
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-unplugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] No waiting events found dispatching network-vif-unplugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:29 user nova-compute[73458]: DEBUG nova.compute.manager [req-80e6caa2-6190-4fa8-a913-7e9981562be6 req-bfe5bd67-cfda-47e8-ada1-2582c6085691 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-unplugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Instance destroyed successfully.
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.objects.instance [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lazy-loading 'resources' on Instance uuid 9f140de9-a7eb-4041-a79f-241a9f85b35b {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:48:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1627516867',display_name='tempest-ServersNegativeTestJSON-server-1627516867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1627516867',id=2,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d6f575c140547d2ae48ed7dea334375',ramdisk_id='',reservation_id='r-1ts7k3dd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2010218333',owner_user_name='tempest-ServersNegativeTestJSON-2010218333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:48:47Z,user_data=None,user_id='24e9f78541bc45c48b4e0637f666e9cd',uuid=9f140de9-a7eb-4041-a79f-241a9f85b35b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converting VIF {"id": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "address": "fa:16:3e:61:98:3b", "network": {"id": "3cc7de17-3593-4361-b93e-94a76fe1807d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2067583873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d6f575c140547d2ae48ed7dea334375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fef02f1-85", "ovs_interfaceid": "6fef02f1-8592-4b68-ac49-03ee0e1f721e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG os_vif [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fef02f1-85, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:57:30 user nova-compute[73458]: INFO os_vif [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:98:3b,bridge_name='br-int',has_traffic_filtering=True,id=6fef02f1-8592-4b68-ac49-03ee0e1f721e,network=Network(3cc7de17-3593-4361-b93e-94a76fe1807d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fef02f1-85')
Aug 27 00:57:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Deleting instance files /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b_del
Aug 27 00:57:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Deletion of /opt/stack/data/nova/instances/9f140de9-a7eb-4041-a79f-241a9f85b35b_del complete
Aug 27 00:57:30 user nova-compute[73458]: INFO nova.compute.manager [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 00:57:30 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:57:30 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:31 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Took 0.54 seconds to deallocate network for instance.
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-17ac51a1-0533-4e91-b6df-59e79a8f100a req-1cee0417-d0ec-4079-a5b5-3cb35e2b04ec service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-deleted-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:31 user nova-compute[73458]: INFO nova.compute.manager [req-17ac51a1-0533-4e91-b6df-59e79a8f100a req-1cee0417-d0ec-4079-a5b5-3cb35e2b04ec service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Neutron deleted interface 6fef02f1-8592-4b68-ac49-03ee0e1f721e; detaching it from the instance and deleting it from the info cache
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-17ac51a1-0533-4e91-b6df-59e79a8f100a req-1cee0417-d0ec-4079-a5b5-3cb35e2b04ec service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-17ac51a1-0533-4e91-b6df-59e79a8f100a req-1cee0417-d0ec-4079-a5b5-3cb35e2b04ec service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Detach interface failed, port_id=6fef02f1-8592-4b68-ac49-03ee0e1f721e, reason: Instance 9f140de9-a7eb-4041-a79f-241a9f85b35b could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:31 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Deleted allocations for instance 9f140de9-a7eb-4041-a79f-241a9f85b35b
Aug 27 00:57:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-402f439d-5884-4726-962e-da3401c59bd6 tempest-ServersNegativeTestJSON-2010218333 tempest-ServersNegativeTestJSON-2010218333-project-member] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] Acquiring lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] Lock "9f140de9-a7eb-4041-a79f-241a9f85b35b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] No waiting events found dispatching network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:32 user nova-compute[73458]: WARNING nova.compute.manager [req-f191056d-3792-4125-892e-ee142adb2540 req-c1406657-6d37-43a6-ae8c-dbc271de6326 service nova] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Received unexpected event network-vif-plugged-6fef02f1-8592-4b68-ac49-03ee0e1f721e for instance with vm_state deleted and task_state None.
Aug 27 00:57:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-changed-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Refreshing instance network info cache due to event network-changed-0e1f9cd4-9e02-4736-a736-0c8056657be9. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] Acquiring lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] Acquired lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Refreshing network info cache for port 0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updated VIF entry in instance network info cache for port 0e1f9cd4-9e02-4736-a736-0c8056657be9. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.network.neutron [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating instance_info_cache with network_info: [{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84d3e969-ea44-47ba-9043-a87d75d939d0 req-1bc392d6-195a-40f6-abfc-9402a9f68b4b service nova] Releasing lock "refresh_cache-4d0794fa-2561-4577-bb68-08fe675d50e4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG nova.objects.instance [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'flavor' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:39 user nova-compute[73458]: INFO nova.compute.manager [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attaching volume 06c36210-7bfe-4b45-a531-9b514304f60a to /dev/vdb
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cfc76f-9438-41f0-88b0-e2d7df970308]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[afda6267-e81f-44e6-8e6e-4a403ecbaf34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7804ea48-1cd2-4ec5-80d2-72a653b68833]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8c33f-eed4-4467-8bea-755d88dbd62a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:57:40 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:57:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2436dc6-7c7e-4e2e-aa13-2573cd24413e]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating existing volume attachment record: de083b7d-9a27-4424-aa17-bcc76dd25ca0 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:40 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097845.604982, 014595b9-5cb2-4a12-a96c-b57ee091c8ed => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:40 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] VM Stopped (Lifecycle Event)
Aug 27 00:57:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-979bc3fa-6457-4753-a1dc-65d9db835a5f None None] [instance: 014595b9-5cb2-4a12-a96c-b57ee091c8ed] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:45 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097850.4571407, 9f140de9-a7eb-4041-a79f-241a9f85b35b => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:57:45 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] VM Stopped (Lifecycle Event)
Aug 27 00:57:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ab0b3cda-9b43-4523-8b6b-8675bf0d6746 None None] [instance: 9f140de9-a7eb-4041-a79f-241a9f85b35b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:51 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:51 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b94f4a5-d135-420d-b8fd-43825020fd4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:57:51 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623fb47-0393-4d59-ad67-31446a83acf2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a] added
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63716440-355b-48ff-b832-555f5a8d363b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac6fb9-4256-4ebf-af6c-f278bccf2395]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJCLiPyN {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJCLiPyN" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285b7c4-6c46-422a-b129-295b12d88e21]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJCLiPyN'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53c7aef-8210-4404-9605-0a4d3334fa85]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ef17cf-abf6-42c8-8823-6d49068bbad2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a3330-ee49-41c4-9c57-939908fc5c1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]
Aug 27 00:57:51 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9eaf36-8121-457b-a18a-7e20da236cbf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd406c-19e2-4ef7-b42a-644b3c939d9d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:51 user nova-compute[73458]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:57:51 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a2c93-8f0a-49cb-beff-3cd88a269dec]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:51 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26236383530363861', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236383530363861', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'flavor' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:57:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 00:57:52 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:57:52 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:57:52 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:57:52 user nova-compute[73458]:   <serial>06c36210-7bfe-4b45-a531-9b514304f60a</serial>
Aug 27 00:57:52 user nova-compute[73458]: </disk>
Aug 27 00:57:52 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 00:57:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:57:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:0d:64:50, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:57:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-25cb5659-f6a2-4ed0-a6c4-03f3eacd7cba tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.480s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:54 user nova-compute[73458]: INFO nova.compute.manager [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Rebuilding instance
Aug 27 00:57:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:55 user nova-compute[73458]: WARNING nova.compute.manager [req-c91c86c5-ab2c-4420-9d4e-9878ffb1651b req-89ae8eda-c7fb-4863-94cd-c178f1a2aedc service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state active and task_state rebuilding.
Aug 27 00:57:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance destroyed successfully.
Aug 27 00:57:55 user nova-compute[73458]: INFO nova.compute.manager [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Detaching volume 06c36210-7bfe-4b45-a531-9b514304f60a
Aug 27 00:57:55 user nova-compute[73458]: INFO nova.virt.block_device [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attempting to driver detach volume 06c36210-7bfe-4b45-a531-9b514304f60a from mountpoint /dev/vdb
Aug 27 00:57:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Attempting to detach device vdb from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:57:55 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:57:55 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 00:57:55 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:57:55 user nova-compute[73458]:   <serial>06c36210-7bfe-4b45-a531-9b514304f60a</serial>
Aug 27 00:57:55 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:57:55 user nova-compute[73458]: </disk>
Aug 27 00:57:55 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:57:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully detached device vdb from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the persistent domain config.
Aug 27 00:57:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:55 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00220ab-6092-4656-8286-df3f336dea75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0372db-b2c5-4f6c-97c8-46e5b6e9e4ff]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:55 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:55 user nova-compute[73458]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:57:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:55 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:55 user nova-compute[73458]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:57:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78533760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af01a7d-19b2-4d60-8ed5-75be107b22ec]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf7a5a-1ef8-4832-a4ee-97842c2946dd]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[676223e6-3cd8-4e9e-87ef-de5ffe03067c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b228d3eb-3ef3-4fa5-99e0-0c48d09a21dd]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13349a-5145-451c-9e99-c4f0482f6726]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f264e29-be05-4773-be22-23ad5878126e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]
Aug 27 00:57:56 user nova-compute[73458]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.
Aug 27 00:57:56 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0240deef-5bcf-4514-9422-00dacb2cc218]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== disconnect_volume: return (282ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:57:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance destroyed successfully.
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-ServerActionsTestOtherA-server-1313754681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e1f9cd4-9e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:57:57 user nova-compute[73458]: INFO os_vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e')
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db594b52-5ab9-476a-985b-83c44be22230]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bb6af7-3191-4952-aa7a-3cca139ad254]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:57 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:57:57 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:57:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78728820>, {}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Disconnecting from: [] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== disconnect_volume: return (53ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:57:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Deleting instance files /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4_del
Aug 27 00:57:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Deletion of /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4_del complete
Aug 27 00:57:57 user nova-compute[73458]: INFO nova.virt.block_device [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Booting with volume 06c36210-7bfe-4b45-a531-9b514304f60a at /dev/vdb
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.utils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802d306-d1e0-48e5-b43b-d98f4748a0e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bbd033-dad8-40b2-a79b-fc00474f2ffc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:57:57 user nova-compute[73458]: WARNING nova.compute.manager [req-5067f06b-6e8a-411b-a851-35eb77a7396d req-14373263-e35f-4c3e-8a82-e16be418b97e service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd84aab-130c-4de1-9ba9-06899b55af9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6798f7-5dae-4843-a6e6-c49d6a0afc76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:57:57 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:57:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d5bcf-d78e-4fd7-8693-7116a9f114d2]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG os_brick.utils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:57:57 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating existing volume attachment record: bc14e9f1-86c2-40a7-9122-44556f51513b {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:57:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:58:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Creating image(s)
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk 1073741824" returned: 0 in 0.047s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Cannot resize image /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Ensure instance console log exists: /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start _get_guest_xml network_info=[{"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4d0794fa-2561-4577-bb68-08fe675d50e4', 'attached_at': '', 'detached_at': '', 'volume_id': '06c36210-7bfe-4b45-a531-9b514304f60a', 'serial': '06c36210-7bfe-4b45-a531-9b514304f60a'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'bc14e9f1-86c2-40a7-9122-44556f51513b', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:58:09 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 00:58:09 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:58:09 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:09 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:09 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe5ceba-ae4d-4188-a744-c5a8a69cd256]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:58:09 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccb902-83e7-4149-80fc-4e16bfe8c87d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a] added
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa1405-99da-4d89-8977-4df03b3e0dce]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da141ea-a69c-42bd-8c99-e36931188d48]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJCLiPyN {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XJCLiPyN" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe08c5-83ae-4ed9-98d8-2100e0e3e5b7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XJCLiPyN'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[58222ee3-3e53-469a-935a-8cc33e072171]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1214c75-9882-46bf-9e49-16152b516e17]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df69d75-e288-4752-bb03-c7ec162bde58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]
Aug 27 00:58:09 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9674c95d-c500-4263-adf7-b3382c813fa1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0071cc83-045c-4bbe-8e74-4f1d137c0ecb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:09 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[da633e07-785f-4454-8cf8-6473cd2ff9cc]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:58:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097875.7064834, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:10 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Stopped (Lifecycle Event)
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-61389d26-edcc-447a-8234-f890b62be872 None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26236383530363861', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236383530363861', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-ServerActionsTestOtherA-server-1313754681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:58:10 user nova-compute[73458]:   <uuid>4d0794fa-2561-4577-bb68-08fe675d50e4</uuid>
Aug 27 00:58:10 user nova-compute[73458]:   <name>instance-00000014</name>
Aug 27 00:58:10 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:58:10 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:58:10 user nova-compute[73458]:   <metadata>
Aug 27 00:58:10 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:58:10 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherA-server-1313754681</nova:name>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:58:09</nova:creationTime>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:58:10 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:58:10 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:owner>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:user uuid="15e8844b6f594cef9e904b88a6ca42b9">tempest-ServerActionsTestOtherA-1449025138-project-member</nova:user>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:project uuid="bd605e8ac6e749718ba402ae385a24bd">tempest-ServerActionsTestOtherA-1449025138</nova:project>
Aug 27 00:58:10 user nova-compute[73458]:       </nova:owner>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:58:10 user nova-compute[73458]:       <nova:ports>
Aug 27 00:58:10 user nova-compute[73458]:         <nova:port uuid="0e1f9cd4-9e02-4736-a736-0c8056657be9">
Aug 27 00:58:10 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 00:58:10 user nova-compute[73458]:         </nova:port>
Aug 27 00:58:10 user nova-compute[73458]:       </nova:ports>
Aug 27 00:58:10 user nova-compute[73458]:     </nova:instance>
Aug 27 00:58:10 user nova-compute[73458]:   </metadata>
Aug 27 00:58:10 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:58:10 user nova-compute[73458]:     <system>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="serial">4d0794fa-2561-4577-bb68-08fe675d50e4</entry>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="uuid">4d0794fa-2561-4577-bb68-08fe675d50e4</entry>
Aug 27 00:58:10 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:58:10 user nova-compute[73458]:     </system>
Aug 27 00:58:10 user nova-compute[73458]:   </sysinfo>
Aug 27 00:58:10 user nova-compute[73458]:   <os>
Aug 27 00:58:10 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:58:10 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:58:10 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:58:10 user nova-compute[73458]:   </os>
Aug 27 00:58:10 user nova-compute[73458]:   <features>
Aug 27 00:58:10 user nova-compute[73458]:     <acpi/>
Aug 27 00:58:10 user nova-compute[73458]:     <apic/>
Aug 27 00:58:10 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:58:10 user nova-compute[73458]:   </features>
Aug 27 00:58:10 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:58:10 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:58:10 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:58:10 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:58:10 user nova-compute[73458]:   </clock>
Aug 27 00:58:10 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:58:10 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:58:10 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:58:10 user nova-compute[73458]:   </cpu>
Aug 27 00:58:10 user nova-compute[73458]:   <devices>
Aug 27 00:58:10 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:58:10 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:58:10 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk"/>
Aug 27 00:58:10 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:58:10 user nova-compute[73458]:     </disk>
Aug 27 00:58:10 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:58:10 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:58:10 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 00:58:10 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:58:10 user nova-compute[73458]:       <serial>06c36210-7bfe-4b45-a531-9b514304f60a</serial>
Aug 27 00:58:10 user nova-compute[73458]:     </disk>
Aug 27 00:58:10 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:58:10 user nova-compute[73458]:       <mac address="fa:16:3e:0d:64:50"/>
Aug 27 00:58:10 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:10 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:58:10 user nova-compute[73458]:       <target dev="tap0e1f9cd4-9e"/>
Aug 27 00:58:10 user nova-compute[73458]:     </interface>
Aug 27 00:58:10 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:58:10 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/console.log" append="off"/>
Aug 27 00:58:10 user nova-compute[73458]:     </serial>
Aug 27 00:58:10 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:58:10 user nova-compute[73458]:     <video>
Aug 27 00:58:10 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:10 user nova-compute[73458]:     </video>
Aug 27 00:58:10 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:58:10 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:58:10 user nova-compute[73458]:     </rng>
Aug 27 00:58:10 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:58:10 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:58:10 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:58:10 user nova-compute[73458]:     </memballoon>
Aug 27 00:58:10 user nova-compute[73458]:   </devices>
Aug 27 00:58:10 user nova-compute[73458]: </domain>
Aug 27 00:58:10 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-ServerActionsTestOtherA-server-1313754681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG os_vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e1f9cd4-9e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e1f9cd4-9e, col_values=(('external_ids', {'iface-id': '0e1f9cd4-9e02-4736-a736-0c8056657be9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:64:50', 'vm-uuid': '4d0794fa-2561-4577-bb68-08fe675d50e4'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:58:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:10 user nova-compute[73458]: INFO os_vif [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e')
Aug 27 00:58:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:0d:64:50, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:12 user nova-compute[73458]: WARNING nova.compute.manager [req-09e75475-07ba-49af-af34-ac6cbe65d756 req-bd2b9b06-3a49-46d5-bed8-8c379094392c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state active and task_state rebuild_spawning.
Aug 27 00:58:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097894.3479228, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Resumed (Lifecycle Event)
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:58:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance spawned successfully.
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:58:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097894.352201, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Started (Lifecycle Event)
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73458) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:14 user nova-compute[73458]: WARNING nova.compute.manager [req-dca89bce-32e0-4ca7-9d4f-92e699f02067 req-efe224eb-9233-4b07-9427-f4477db65059 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state active and task_state None.
Aug 27 00:58:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6add5581-8dc2-44fd-bd6f-692d3eb8e45f tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:58:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.308s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:58:30 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:30 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.435375213623047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:30 user nova-compute[73458]: INFO nova.compute.manager [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Unshelving
Aug 27 00:58:30 user nova-compute[73458]: INFO nova.virt.block_device [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Booting with volume 7c946578-6315-48cb-9672-3331d4161603 at /dev/vdc
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a261c7ca-0d55-492e-8601-d5819b9d8fee has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG os_brick.utils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f131b3d1-1558-4984-94f2-8c8f27e17314]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82af05-be9b-4965-ac9c-28ffcaa208bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4d6a98-eb08-4097-909a-d70f94f28794]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e78bd-f827-4531-b0cd-3a1e09a82f22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 00:58:31 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 00:58:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af2491-cacc-4ce2-8bdc-a6273ee1d22e]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG os_brick.utils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating existing volume attachment record: 7fe67a71-3e48-487f-8085-e8acbe69ce8c {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:58:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:58:34 user nova-compute[73458]: INFO nova.compute.manager [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Rescuing
Aug 27 00:58:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:35 user nova-compute[73458]: WARNING nova.compute.manager [req-04943e65-235e-4434-8259-ca5166e64f71 req-578aafeb-8967-4f0f-bc45-8c359f9bca29 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state rescuing.
Aug 27 00:58:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance destroyed successfully.
Aug 27 00:58:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Attempting a stable device rescue
Aug 27 00:58:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 00:58:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Creating image(s)
Aug 27 00:58:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.part --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG nova.virt.images [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] bf49e208-ae35-4291-84a8-63fe019215fe was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.part /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:37 user nova-compute[73458]: WARNING nova.compute.manager [req-aedef8b7-95ff-47f1-b3f2-92237b188062 req-fb18927a-ed5b-435f-9f29-3b10552c5fab service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state rescuing.
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.part /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.converted" returned: 0 in 0.557s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05 --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05,backing_fmt=raw /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05,backing_fmt=raw /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue" returned: 0 in 0.055s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "94d7a9dd8d778e4f6b92f2e475a00469e630bc05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'migration_context' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<85e602b0-6c12-4d09-825c-ececd08c663a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start _get_guest_xml network_info=[{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:78:ed:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf49e208-ae35-4291-84a8-63fe019215fe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '85e602b0-6c12-4d09-825c-ececd08c663a', 'attached_at': '', 'detached_at': '', 'volume_id': '8715b73e-094f-4742-a399-65c61abcb6c8', 'serial': '8715b73e-094f-4742-a399-65c61abcb6c8'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '433d1030-d533-45e5-9907-a790dbacd8b4', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<85e602b0-6c12-4d09-825c-ececd08c663a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'numa_topology' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<85e602b0-6c12-4d09-825c-ececd08c663a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<85e602b0-6c12-4d09-825c-ececd08c663a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:58:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:38 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb5ae1-de1c-41d6-82dd-6b198c2e6b7a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zwDUqrSt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 00:58:38 user nova-compute[73458]: node.name = iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8
Aug 27 00:58:38 user nova-compute[73458]: node.tpgt = -1
Aug 27 00:58:38 user nova-compute[73458]: node.startup = automatic
Aug 27 00:58:38 user nova-compute[73458]: node.leading_login = No
Aug 27 00:58:38 user nova-compute[73458]: iface.iscsi_ifacename = default
Aug 27 00:58:38 user nova-compute[73458]: iface.net_ifacename = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.ipaddress = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.prefix_len = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.hwaddress = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.transport_name = tcp
Aug 27 00:58:38 user nova-compute[73458]: iface.initiatorname = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.vlan_id = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.vlan_priority = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.vlan_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.iface_num = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.mtu = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.port = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.bootproto = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.subnet_mask = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.gateway = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_alt_client_id = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_dns = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_learn_iqn = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_vendor_id_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_vendor_id = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.dhcp_slp_da = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.fragmentation = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.gratuitous_arp = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.incoming_forwarding = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.tos_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.tos = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.ttl = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.delayed_ack = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.tcp_nagle = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.tcp_wsf_state = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.tcp_wsf = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.tcp_timer_scale = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.tcp_timestamp = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.redirect = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.def_task_mgmt_timeout = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.header_digest = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.data_digest = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.immediate_data = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.initial_r2t = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.data_seq_inorder = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.data_pdu_inorder = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.erl = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.max_receive_data_len = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.first_burst_len = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.max_outstanding_r2t = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.max_burst_len = 0
Aug 27 00:58:38 user nova-compute[73458]: iface.chap_auth = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.bidi_chap = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.strict_login_compliance = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.discovery_auth = <empty>
Aug 27 00:58:38 user nova-compute[73458]: iface.discovery_logout = <empty>
Aug 27 00:58:38 user nova-compute[73458]: node.discovery_address = <empty>
Aug 27 00:58:38 user nova-compute[73458]: node.discovery_port = 0
Aug 27 00:58:38 user nova-compute[73458]: node.discovery_type = static
Aug 27 00:58:38 user nova-compute[73458]: node.session.initial_cmdsn = 0
Aug 27 00:58:38 user nova-compute[73458]: node.session.initial_login_retry_max = 8
Aug 27 00:58:38 user nova-compute[73458]: node.session.xmit_thread_priority = -20
Aug 27 00:58:38 user nova-compute[73458]: node.session.cmds_max = 128
Aug 27 00:58:38 user nova-compute[73458]: node.session.queue_depth = 32
Aug 27 00:58:38 user nova-compute[73458]: node.session.nr_sessions = 1
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.authmethod = CHAP
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.username = zwDUqrSt
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.password = ***
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.username_in = <empty>
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.password_in = <empty>
Aug 27 00:58:38 user nova-compute[73458]: node.session.auth.chap_algs = MD5
Aug 27 00:58:38 user nova-compute[73458]: node.session.timeo.replacement_timeout = 120
Aug 27 00:58:38 user nova-compute[73458]: node.session.err_timeo.abort_timeout = 15
Aug 27 00:58:38 user nova-compute[73458]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 00:58:38 user nova-compute[73458]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 00:58:38 user nova-compute[73458]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.FastAbort = Yes
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.InitialR2T = No
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.ImmediateData = Yes
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.MaxConnections = 1
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 00:58:38 user nova-compute[73458]: node.session.iscsi.ERL = 0
Aug 27 00:58:38 user nova-compute[73458]: node.session.scan = manual
Aug 27 00:58:38 user nova-compute[73458]: node.session.reopen_max = 0
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].address = 172.16.0.220
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].port = 3260
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].startup = manual
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].tcp.window_size = 524288
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].tcp.type_of_service = 0
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].timeo.logout_timeout = 15
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].timeo.login_timeout = 15
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].timeo.auth_timeout = 45
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.DataDigest = None
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.IFMarker = No
Aug 27 00:58:38 user nova-compute[73458]: node.conn[0].iscsi.OFMarker = No
Aug 27 00:58:38 user nova-compute[73458]: # END RECORD
Aug 27 00:58:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc0baf-6143-4c8a-a441-dafb150430ab]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2318f-a786-4cb5-abae-755a6fbf78dc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwDUqrSt {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwDUqrSt" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b30d194-b14d-412e-9e98-c10a150fe117]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwDUqrSt'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3432a1-d4e8-44c0-924d-6794fc5c85e5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecbfa4-bf59-41c9-9484-128f8bc712c4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:38 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:38 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:38 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:38 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.182s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] HCTL ('35', '0', '0', 0) found on session 25 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb38f7c0-0589-496d-95f0-4c500efa5f63]: (4, ('0 0 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching for a device in session 25 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.209s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== connect_volume: return (211ms) {'type': 'block', 'scsi_wwn': '23037633865653435', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037633865653435', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1715805118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1715805118',id=21,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-pt4850kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:57:10Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=85e602b0-6c12-4d09-825c-ececd08c663a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:78:ed:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:78:ed:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.objects.base [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<85e602b0-6c12-4d09-825c-ececd08c663a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:58:38 user nova-compute[73458]:   <uuid>85e602b0-6c12-4d09-825c-ececd08c663a</uuid>
Aug 27 00:58:38 user nova-compute[73458]:   <name>instance-00000015</name>
Aug 27 00:58:38 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:58:38 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:58:38 user nova-compute[73458]:   <metadata>
Aug 27 00:58:38 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:58:38 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1715805118</nova:name>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:58:38</nova:creationTime>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:58:38 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:58:38 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:owner>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 00:58:38 user nova-compute[73458]:       </nova:owner>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:58:38 user nova-compute[73458]:       <nova:ports>
Aug 27 00:58:38 user nova-compute[73458]:         <nova:port uuid="ef531fea-3dc7-46ee-99e3-c224e729dc9c">
Aug 27 00:58:38 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 00:58:38 user nova-compute[73458]:         </nova:port>
Aug 27 00:58:38 user nova-compute[73458]:       </nova:ports>
Aug 27 00:58:38 user nova-compute[73458]:     </nova:instance>
Aug 27 00:58:38 user nova-compute[73458]:   </metadata>
Aug 27 00:58:38 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:58:38 user nova-compute[73458]:     <system>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="serial">85e602b0-6c12-4d09-825c-ececd08c663a</entry>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="uuid">85e602b0-6c12-4d09-825c-ececd08c663a</entry>
Aug 27 00:58:38 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:58:38 user nova-compute[73458]:     </system>
Aug 27 00:58:38 user nova-compute[73458]:   </sysinfo>
Aug 27 00:58:38 user nova-compute[73458]:   <os>
Aug 27 00:58:38 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:58:38 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:58:38 user nova-compute[73458]:   </os>
Aug 27 00:58:38 user nova-compute[73458]:   <features>
Aug 27 00:58:38 user nova-compute[73458]:     <acpi/>
Aug 27 00:58:38 user nova-compute[73458]:     <apic/>
Aug 27 00:58:38 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:58:38 user nova-compute[73458]:   </features>
Aug 27 00:58:38 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:58:38 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:58:38 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:58:38 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:58:38 user nova-compute[73458]:   </clock>
Aug 27 00:58:38 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:58:38 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:58:38 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:58:38 user nova-compute[73458]:   </cpu>
Aug 27 00:58:38 user nova-compute[73458]:   <devices>
Aug 27 00:58:38 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:58:38 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:58:38 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 00:58:38 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:58:38 user nova-compute[73458]:       <serial>8715b73e-094f-4742-a399-65c61abcb6c8</serial>
Aug 27 00:58:38 user nova-compute[73458]:     </disk>
Aug 27 00:58:38 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:58:38 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:58:38 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue"/>
Aug 27 00:58:38 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 00:58:38 user nova-compute[73458]:       <boot order="1"/>
Aug 27 00:58:38 user nova-compute[73458]:     </disk>
Aug 27 00:58:38 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:58:38 user nova-compute[73458]:       <mac address="fa:16:3e:78:ed:e7"/>
Aug 27 00:58:38 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:38 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:58:38 user nova-compute[73458]:       <target dev="tapef531fea-3d"/>
Aug 27 00:58:38 user nova-compute[73458]:     </interface>
Aug 27 00:58:38 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:58:38 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/console.log" append="off"/>
Aug 27 00:58:38 user nova-compute[73458]:     </serial>
Aug 27 00:58:38 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:58:38 user nova-compute[73458]:     <video>
Aug 27 00:58:38 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:38 user nova-compute[73458]:     </video>
Aug 27 00:58:38 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:58:38 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:58:38 user nova-compute[73458]:     </rng>
Aug 27 00:58:38 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:58:38 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:58:38 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:58:38 user nova-compute[73458]:     </memballoon>
Aug 27 00:58:38 user nova-compute[73458]:   </devices>
Aug 27 00:58:38 user nova-compute[73458]: </domain>
Aug 27 00:58:38 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:58:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance destroyed successfully.
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:78:ed:e7, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:40 user nova-compute[73458]: WARNING nova.compute.manager [req-742695c9-ffbe-4a8c-8654-36d9bea48df9 req-cfc37b20-7beb-4368-ba52-f75421921cbc service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state rescuing.
Aug 27 00:58:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:42 user nova-compute[73458]: WARNING nova.compute.manager [req-c49eab25-061e-4b5b-a003-bac0ff810c21 req-c2b990d8-c38c-4b32-a737-73275ff254c5 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state rescuing.
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 85e602b0-6c12-4d09-825c-ececd08c663a due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097922.6257122, 85e602b0-6c12-4d09-825c-ececd08c663a => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:42 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Resumed (Lifecycle Event)
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6694d679-3ef1-468a-9246-1884debdfd43 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:42 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097922.6267602, 85e602b0-6c12-4d09-825c-ececd08c663a => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:42 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Started (Lifecycle Event)
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_requests' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'numa_topology' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:58:43 user nova-compute[73458]: INFO nova.compute.claims [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Claim successful on node user
Aug 27 00:58:44 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:58:44 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:58:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:44 user nova-compute[73458]: INFO nova.network.neutron [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating port c529fc8d-8b36-43bb-8302-f5d042c772b4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing instance network info cache due to event network-changed-c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] Acquiring lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:45 user nova-compute[73458]: INFO nova.compute.manager [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Unrescuing
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:58:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Creating image(s)
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'trusted_certs' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] Acquired lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Refreshing network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG nova.objects.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<a261c7ca-0d55-492e-8601-d5819b9d8fee> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'flavor' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing instance network info cache due to event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.part --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.virt.images [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] 47553cba-ab8e-4f73-9bc1-816e031da83c was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.part /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.part /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.converted" returned: 0 in 0.647s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updated VIF entry in instance network info cache for port c529fc8d-8b36-43bb-8302-f5d042c772b4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated VIF entry in instance network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-267a06f1-14fd-4bcf-8ed2-9e8a38edbcda req-b0d283e0-937c-4f12-a4a0-6ea80662eb6a service nova] Releasing lock "refresh_cache-a261c7ca-0d55-492e-8601-d5819b9d8fee" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-97b9feb5-3195-4269-92d5-bbf5ed3fcc6f req-4df240a5-aa9e-4a24-8c36-510cf0c23545 service nova] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance destroyed successfully.
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.187s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json" returned: 0 in 0.203s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd,backing_fmt=raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd,backing_fmt=raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk 1073741824" returned: 0 in 0.072s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "d5dd7ac48232237b184d6e82d8432dcf1eb49ebd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'migration_context' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:48 user nova-compute[73458]: DEBUG nova.objects.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<a261c7ca-0d55-492e-8601-d5819b9d8fee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Rebasing disk image.
Aug 27 00:58:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 -F raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing instance network info cache due to event network-changed-59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Refreshing network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated VIF entry in instance network info cache for port 59fe0e5c-9ae7-445b-b379-fbf924be540d. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.network.neutron [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:49 user nova-compute[73458]: WARNING nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state rescued and task_state unrescuing.
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:49 user nova-compute[73458]: WARNING nova.compute.manager [req-251c7c17-bfd6-4cc2-8358-0c5c44031ca5 req-0678069a-b84a-4ad7-85a7-71c43abe5935 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state rescued and task_state unrescuing.
Aug 27 00:58:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:51 user nova-compute[73458]: WARNING nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state rescued and task_state unrescuing.
Aug 27 00:58:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:51 user nova-compute[73458]: WARNING nova.compute.manager [req-91a31b25-a92b-4120-b9d9-2294f69b6538 req-b5e08a02-2b15-4bbf-9d9a-17483bd72447 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state rescued and task_state unrescuing.
Aug 27 00:58:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 -F raw /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk" returned: 0 in 2.985s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Ensure instance console log exists: /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start _get_guest_xml network_info=[{"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='471249943fbf5980ace360fb6b48996b',container_format='bare',created_at=2023-08-27T00:56:37Z,direct_url=<?>,disk_format='qcow2',id=47553cba-ab8e-4f73-9bc1-816e031da83c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-894961662-shelved',owner='d726b2aaef554069ace63df4c4e92717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T00:56:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLtpKBoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a261c7ca-0d55-492e-8601-d5819b9d8fee', 'attached_at': '', 'detached_at': '', 'volume_id': '7c946578-6315-48cb-9672-3331d4161603', 'serial': '7c946578-6315-48cb-9672-3331d4161603'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '7fe67a71-3e48-487f-8085-e8acbe69ce8c', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:58:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='471249943fbf5980ace360fb6b48996b',container_format='bare',created_at=2023-08-27T00:56:37Z,direct_url=<?>,disk_format='qcow2',id=47553cba-ab8e-4f73-9bc1-816e031da83c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-894961662-shelved',owner='d726b2aaef554069ace63df4c4e92717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T00:56:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'vcpu_model' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.objects.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<a261c7ca-0d55-492e-8601-d5819b9d8fee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLtpKBoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:58:52 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:52 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:58:52 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb8a793-7d85-45c0-832b-4901eed7894a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 00:58:52 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e9414f-74b9-4a67-87dd-4bdb5f1c1489]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603] added
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[070895b4-8d51-4af6-b0c7-ebdb47735970]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a0eb6c-85d4-4eb9-a063-8364ebb7691d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLtpKBoJ {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLtpKBoJ" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfd12c-a6f5-4584-844d-d278c97551b8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLtpKBoJ'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d638d-8b38-4990-b18b-5dc4ad78e802]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c6698a-4745-45c4-b3b6-2d17c46eef25]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3213f8e1-d44b-418a-bf4b-059a2055abce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260]
Aug 27 00:58:52 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260] successful.
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4d517e-de2d-45b6-ac76-3fd031e0c8a5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b95b8-2222-4d5c-987f-a6e68614cbd6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:58:52 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 00:58:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca3ffd-c0f7-400a-82c7-73cfe7b0ff19]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d3aa1936-36a6-4e85-aef8-34bb52f8dbce tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for f4f1df39-5fd2-4ede-a842-490239d576fb due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097932.5374393, f4f1df39-5fd2-4ede-a842-490239d576fb => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Resumed (Lifecycle Event)
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097932.5385196, f4f1df39-5fd2-4ede-a842-490239d576fb => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Started (Lifecycle Event)
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLtpKBoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23838313435303331', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838313435303331', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='47553cba-ab8e-4f73-9bc1-816e031da83c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1066942134',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T00:56:41.030367',shelved_host='user',shelved_image_id='47553cba-ab8e-4f73-9bc1-816e031da83c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_devices' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.objects.base [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<a261c7ca-0d55-492e-8601-d5819b9d8fee> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:58:53 user nova-compute[73458]:   <uuid>a261c7ca-0d55-492e-8601-d5819b9d8fee</uuid>
Aug 27 00:58:53 user nova-compute[73458]:   <name>instance-00000011</name>
Aug 27 00:58:53 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:58:53 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:58:53 user nova-compute[73458]:   <metadata>
Aug 27 00:58:53 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:58:53 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-894961662</nova:name>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:58:52</nova:creationTime>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:58:53 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:58:53 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:owner>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:user uuid="017197a0401c456f97c4260b62669916">tempest-AttachVolumeShelveTestJSON-462549752-project-member</nova:user>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:project uuid="d726b2aaef554069ace63df4c4e92717">tempest-AttachVolumeShelveTestJSON-462549752</nova:project>
Aug 27 00:58:53 user nova-compute[73458]:       </nova:owner>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:root type="image" uuid="47553cba-ab8e-4f73-9bc1-816e031da83c"/>
Aug 27 00:58:53 user nova-compute[73458]:       <nova:ports>
Aug 27 00:58:53 user nova-compute[73458]:         <nova:port uuid="c529fc8d-8b36-43bb-8302-f5d042c772b4">
Aug 27 00:58:53 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 00:58:53 user nova-compute[73458]:         </nova:port>
Aug 27 00:58:53 user nova-compute[73458]:       </nova:ports>
Aug 27 00:58:53 user nova-compute[73458]:     </nova:instance>
Aug 27 00:58:53 user nova-compute[73458]:   </metadata>
Aug 27 00:58:53 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:58:53 user nova-compute[73458]:     <system>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="serial">a261c7ca-0d55-492e-8601-d5819b9d8fee</entry>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="uuid">a261c7ca-0d55-492e-8601-d5819b9d8fee</entry>
Aug 27 00:58:53 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:58:53 user nova-compute[73458]:     </system>
Aug 27 00:58:53 user nova-compute[73458]:   </sysinfo>
Aug 27 00:58:53 user nova-compute[73458]:   <os>
Aug 27 00:58:53 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:58:53 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:58:53 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:58:53 user nova-compute[73458]:   </os>
Aug 27 00:58:53 user nova-compute[73458]:   <features>
Aug 27 00:58:53 user nova-compute[73458]:     <acpi/>
Aug 27 00:58:53 user nova-compute[73458]:     <apic/>
Aug 27 00:58:53 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:58:53 user nova-compute[73458]:   </features>
Aug 27 00:58:53 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:58:53 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:58:53 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:58:53 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:58:53 user nova-compute[73458]:   </clock>
Aug 27 00:58:53 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:58:53 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:58:53 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:58:53 user nova-compute[73458]:   </cpu>
Aug 27 00:58:53 user nova-compute[73458]:   <devices>
Aug 27 00:58:53 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:58:53 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:58:53 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk"/>
Aug 27 00:58:53 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:58:53 user nova-compute[73458]:     </disk>
Aug 27 00:58:53 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 00:58:53 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:58:53 user nova-compute[73458]:       <source dev="/dev/sde"/>
Aug 27 00:58:53 user nova-compute[73458]:       <target dev="vdc" bus="virtio"/>
Aug 27 00:58:53 user nova-compute[73458]:       <serial>7c946578-6315-48cb-9672-3331d4161603</serial>
Aug 27 00:58:53 user nova-compute[73458]:     </disk>
Aug 27 00:58:53 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:58:53 user nova-compute[73458]:       <mac address="fa:16:3e:f2:c0:4f"/>
Aug 27 00:58:53 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:53 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:58:53 user nova-compute[73458]:       <target dev="tapc529fc8d-8b"/>
Aug 27 00:58:53 user nova-compute[73458]:     </interface>
Aug 27 00:58:53 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:58:53 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/console.log" append="off"/>
Aug 27 00:58:53 user nova-compute[73458]:     </serial>
Aug 27 00:58:53 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:58:53 user nova-compute[73458]:     <video>
Aug 27 00:58:53 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:58:53 user nova-compute[73458]:     </video>
Aug 27 00:58:53 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:58:53 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:58:53 user nova-compute[73458]:     </rng>
Aug 27 00:58:53 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:58:53 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:58:53 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:58:53 user nova-compute[73458]:     </memballoon>
Aug 27 00:58:53 user nova-compute[73458]:   </devices>
Aug 27 00:58:53 user nova-compute[73458]: </domain>
Aug 27 00:58:53 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='47553cba-ab8e-4f73-9bc1-816e031da83c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1066942134',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T00:56:41.030367',shelved_host='user',shelved_image_id='47553cba-ab8e-4f73-9bc1-816e031da83c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG os_vif [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc529fc8d-8b, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc529fc8d-8b, col_values=(('external_ids', {'iface-id': 'c529fc8d-8b36-43bb-8302-f5d042c772b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:c0:4f', 'vm-uuid': 'a261c7ca-0d55-492e-8601-d5819b9d8fee'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:53 user nova-compute[73458]: INFO os_vif [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b')
Aug 27 00:58:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:58:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No VIF found with MAC fa:16:3e:f2:c0:4f, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:58:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097938.208173, a261c7ca-0d55-492e-8601-d5819b9d8fee => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:58 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Resumed (Lifecycle Event)
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:58:58 user nova-compute[73458]: WARNING nova.compute.manager [req-e95e8d24-45cc-4642-8b06-08355c1b4db2 req-b8653e56-98e8-4c2c-af91-4d785c63bd52 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:58 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance spawned successfully.
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:58 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097938.2120433, a261c7ca-0d55-492e-8601-d5819b9d8fee => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:58:58 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Started (Lifecycle Event)
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:58:58 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:58:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:58:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9c1ababf-2c7f-4fd8-8c0a-60552da73497 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.018s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:59:00 user nova-compute[73458]: WARNING nova.compute.manager [req-c8c7a418-11c7-421c-9576-eb7137563e9b req-68f8f788-bd43-45a6-8c4f-99b909b91931 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state active and task_state None.
Aug 27 00:59:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:02 user nova-compute[73458]: INFO nova.compute.manager [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Terminating instance
Aug 27 00:59:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-unplugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] No waiting events found dispatching network-vif-unplugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c1b3b7a-4295-4f0e-82ee-f326906bbc47 req-4c97c888-e4d3-4591-af08-96d1725904ff service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-unplugged-258691df-7086-4165-a6ce-caff4f3565a2 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Instance destroyed successfully.
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'resources' on Instance uuid ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-992638498',display_name='tempest-VolumesAdminNegativeTest-server-992638498',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-992638498',id=22,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-7vxac9zk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:57:07Z,user_data=None,user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "258691df-7086-4165-a6ce-caff4f3565a2", "address": "fa:16:3e:f9:6f:a3", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap258691df-70", "ovs_interfaceid": "258691df-7086-4165-a6ce-caff4f3565a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG os_vif [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap258691df-70, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:59:03 user nova-compute[73458]: INFO os_vif [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=258691df-7086-4165-a6ce-caff4f3565a2,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap258691df-70')
Aug 27 00:59:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Deleting instance files /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c_del
Aug 27 00:59:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Deletion of /opt/stack/data/nova/instances/ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c_del complete
Aug 27 00:59:03 user nova-compute[73458]: INFO nova.compute.manager [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 00:59:03 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 00:59:03 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 00:59:04 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:59:04 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Took 1.10 seconds to deallocate network for instance.
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] Acquiring lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] No waiting events found dispatching network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:59:05 user nova-compute[73458]: WARNING nova.compute.manager [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received unexpected event network-vif-plugged-258691df-7086-4165-a6ce-caff4f3565a2 for instance with vm_state deleted and task_state None.
Aug 27 00:59:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-b184294b-6b0e-4291-ae14-65f21b694381 req-fba2fbe2-d40f-44ef-aba6-e9a41b898a11 service nova] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Received event network-vif-deleted-258691df-7086-4165-a6ce-caff4f3565a2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:05 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Deleted allocations for instance ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c
Aug 27 00:59:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7f4fd2e3-c63e-4798-93b0-80db3cab33ee tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 00:59:08 user nova-compute[73458]: INFO nova.compute.claims [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Claim successful on node user
Aug 27 00:59:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 00:59:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.policy [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b72e2640d2942d0afb535151f59d755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53826941c0764283b9f07e4f47dcf3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 00:59:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Creating image(s)
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "/opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "/opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "/opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.241s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk 1073741824" returned: 0 in 0.060s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Successfully created port: 85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 00:59:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Cannot resize image /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Ensure instance console log exists: /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Successfully updated port: 85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquired lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-changed-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Refreshing instance network info cache due to event network-changed-85452a67-374e-474b-8682-cbea0810e962. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] Acquiring lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:59:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.neutron [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Updating instance_info_cache with network_info: [{"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Releasing lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Instance network_info: |[{"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] Acquired lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.neutron [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Refreshing network info cache for port 85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Start _get_guest_xml network_info=[{"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 00:59:11 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:59:11 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814246970',display_name='tempest-VolumesActionsTest-instance-814246970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814246970',id=23,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53826941c0764283b9f07e4f47dcf3b9',ramdisk_id='',reservation_id='r-yi1q7fi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-149801617',owner_user_name='tempest-VolumesActionsTest-149801617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:59:09Z,user_data=None,user_id='6b72e2640d2942d0afb535151f59d755',uuid=65a19ede-af2b-42a0-8987-083d081aed64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converting VIF {"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lazy-loading 'pci_devices' on Instance uuid 65a19ede-af2b-42a0-8987-083d081aed64 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] End _get_guest_xml xml=<domain type="kvm">
Aug 27 00:59:11 user nova-compute[73458]:   <uuid>65a19ede-af2b-42a0-8987-083d081aed64</uuid>
Aug 27 00:59:11 user nova-compute[73458]:   <name>instance-00000017</name>
Aug 27 00:59:11 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 00:59:11 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 00:59:11 user nova-compute[73458]:   <metadata>
Aug 27 00:59:11 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 00:59:11 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:name>tempest-VolumesActionsTest-instance-814246970</nova:name>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:creationTime>2023-08-27 00:59:11</nova:creationTime>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 00:59:11 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 00:59:11 user nova-compute[73458]:       </nova:flavor>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:owner>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:user uuid="6b72e2640d2942d0afb535151f59d755">tempest-VolumesActionsTest-149801617-project-member</nova:user>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:project uuid="53826941c0764283b9f07e4f47dcf3b9">tempest-VolumesActionsTest-149801617</nova:project>
Aug 27 00:59:11 user nova-compute[73458]:       </nova:owner>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 00:59:11 user nova-compute[73458]:       <nova:ports>
Aug 27 00:59:11 user nova-compute[73458]:         <nova:port uuid="85452a67-374e-474b-8682-cbea0810e962">
Aug 27 00:59:11 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 00:59:11 user nova-compute[73458]:         </nova:port>
Aug 27 00:59:11 user nova-compute[73458]:       </nova:ports>
Aug 27 00:59:11 user nova-compute[73458]:     </nova:instance>
Aug 27 00:59:11 user nova-compute[73458]:   </metadata>
Aug 27 00:59:11 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 00:59:11 user nova-compute[73458]:     <system>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="serial">65a19ede-af2b-42a0-8987-083d081aed64</entry>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="uuid">65a19ede-af2b-42a0-8987-083d081aed64</entry>
Aug 27 00:59:11 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 00:59:11 user nova-compute[73458]:     </system>
Aug 27 00:59:11 user nova-compute[73458]:   </sysinfo>
Aug 27 00:59:11 user nova-compute[73458]:   <os>
Aug 27 00:59:11 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 00:59:11 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 00:59:11 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 00:59:11 user nova-compute[73458]:   </os>
Aug 27 00:59:11 user nova-compute[73458]:   <features>
Aug 27 00:59:11 user nova-compute[73458]:     <acpi/>
Aug 27 00:59:11 user nova-compute[73458]:     <apic/>
Aug 27 00:59:11 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 00:59:11 user nova-compute[73458]:   </features>
Aug 27 00:59:11 user nova-compute[73458]:   <clock offset="utc">
Aug 27 00:59:11 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 00:59:11 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 00:59:11 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 00:59:11 user nova-compute[73458]:   </clock>
Aug 27 00:59:11 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 00:59:11 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 00:59:11 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 00:59:11 user nova-compute[73458]:   </cpu>
Aug 27 00:59:11 user nova-compute[73458]:   <devices>
Aug 27 00:59:11 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 00:59:11 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 00:59:11 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk"/>
Aug 27 00:59:11 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 00:59:11 user nova-compute[73458]:     </disk>
Aug 27 00:59:11 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 00:59:11 user nova-compute[73458]:       <mac address="fa:16:3e:a7:96:9e"/>
Aug 27 00:59:11 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:59:11 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 00:59:11 user nova-compute[73458]:       <target dev="tap85452a67-37"/>
Aug 27 00:59:11 user nova-compute[73458]:     </interface>
Aug 27 00:59:11 user nova-compute[73458]:     <serial type="pty">
Aug 27 00:59:11 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/console.log" append="off"/>
Aug 27 00:59:11 user nova-compute[73458]:     </serial>
Aug 27 00:59:11 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 00:59:11 user nova-compute[73458]:     <video>
Aug 27 00:59:11 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 00:59:11 user nova-compute[73458]:     </video>
Aug 27 00:59:11 user nova-compute[73458]:     <rng model="virtio">
Aug 27 00:59:11 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 00:59:11 user nova-compute[73458]:     </rng>
Aug 27 00:59:11 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 00:59:11 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 00:59:11 user nova-compute[73458]:       <stats period="10"/>
Aug 27 00:59:11 user nova-compute[73458]:     </memballoon>
Aug 27 00:59:11 user nova-compute[73458]:   </devices>
Aug 27 00:59:11 user nova-compute[73458]: </domain>
Aug 27 00:59:11 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814246970',display_name='tempest-VolumesActionsTest-instance-814246970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814246970',id=23,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53826941c0764283b9f07e4f47dcf3b9',ramdisk_id='',reservation_id='r-yi1q7fi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-149801617',owner_user_name='tempest-VolumesActionsTest-149801617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:59:09Z,user_data=None,user_id='6b72e2640d2942d0afb535151f59d755',uuid=65a19ede-af2b-42a0-8987-083d081aed64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converting VIF {"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG os_vif [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85452a67-37, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85452a67-37, col_values=(('external_ids', {'iface-id': '85452a67-374e-474b-8682-cbea0810e962', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:96:9e', 'vm-uuid': '65a19ede-af2b-42a0-8987-083d081aed64'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:11 user nova-compute[73458]: INFO os_vif [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37')
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] No VIF found with MAC fa:16:3e:a7:96:9e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.neutron [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Updated VIF entry in instance network info cache for port 85452a67-374e-474b-8682-cbea0810e962. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG nova.network.neutron [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Updating instance_info_cache with network_info: [{"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:59:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4ee68236-68b8-44f9-b400-cbd37576fa34 req-e976c380-f75f-4bd8-b2aa-fd3ad7c16c90 service nova] Releasing lock "refresh_cache-65a19ede-af2b-42a0-8987-083d081aed64" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:59:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] No waiting events found dispatching network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:59:13 user nova-compute[73458]: WARNING nova.compute.manager [req-bfe669cf-dba1-4426-9203-e9f7f755e651 req-1742ff31-04bd-4ae0-8d4c-e62a9538f5d8 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received unexpected event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 for instance with vm_state building and task_state spawning.
Aug 27 00:59:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097954.9422538, 65a19ede-af2b-42a0-8987-083d081aed64 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:59:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] VM Resumed (Lifecycle Event)
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 00:59:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Instance spawned successfully.
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 00:59:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:59:14 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693097954.9440641, 65a19ede-af2b-42a0-8987-083d081aed64 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:59:14 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] VM Started (Lifecycle Event)
Aug 27 00:59:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 00:59:15 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 00:59:15 user nova-compute[73458]: INFO nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 27 00:59:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:59:15 user nova-compute[73458]: INFO nova.compute.manager [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Took 6.68 seconds to build instance.
Aug 27 00:59:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-406072d6-833e-4713-b1fd-0f15b7c5b700 tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] No waiting events found dispatching network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 00:59:15 user nova-compute[73458]: WARNING nova.compute.manager [req-0379f123-c717-4322-9430-8816817e560a req-a5f57a34-b588-4144-bde7-e64c3f591692 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received unexpected event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 for instance with vm_state active and task_state None.
Aug 27 00:59:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:18 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693097943.64977, ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 00:59:18 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] VM Stopped (Lifecycle Event)
Aug 27 00:59:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c6c50a79-9777-45dc-8513-e4844f1414e0 None None] [instance: ff20b9a6-ad8c-4ea4-9bfa-c1d48fb22a6c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:19 user nova-compute[73458]: INFO nova.compute.manager [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Detaching volume 8ecbc422-4625-4655-85e3-2360dbf318a1
Aug 27 00:59:19 user nova-compute[73458]: INFO nova.virt.block_device [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Attempting to driver detach volume 8ecbc422-4625-4655-85e3-2360dbf318a1 from mountpoint /dev/vdb
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Attempting to detach device vdb from instance f4f1df39-5fd2-4ede-a842-490239d576fb from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:59:19 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:59:19 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:59:19 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:59:19 user nova-compute[73458]:   <serial>8ecbc422-4625-4655-85e3-2360dbf318a1</serial>
Aug 27 00:59:19 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:59:19 user nova-compute[73458]: </disk>
Aug 27 00:59:19 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:59:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Successfully detached device vdb from instance f4f1df39-5fd2-4ede-a842-490239d576fb from the persistent domain config.
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4f1df39-5fd2-4ede-a842-490239d576fb from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 00:59:19 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 00:59:19 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 00:59:19 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 00:59:19 user nova-compute[73458]:   <serial>8ecbc422-4625-4655-85e3-2360dbf318a1</serial>
Aug 27 00:59:19 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 00:59:19 user nova-compute[73458]: </disk>
Aug 27 00:59:19 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693097959.617262, f4f1df39-5fd2-4ede-a842-490239d576fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 00:59:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Successfully detached device vdb from instance f4f1df39-5fd2-4ede-a842-490239d576fb from the live domain config.
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UkiEQzMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 00:59:19 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec574a3-6018-4dda-86e1-09005cac578c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d722f-f421-433d-9d2a-d8dce0ce4e3e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 00:59:19 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 00:59:19 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78563c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[606c0b37-bea0-43b1-baa0-beb5d9e16d2a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af413441-886d-4a57-8fd6-f8240335261b]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ee231f-2fa4-43a5-b2ac-be74d8c164a2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb73a25-08df-49e7-b1f6-189e257b3937]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c74c4ff-9fb6-42a8-836e-8b2f527aa7e0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d64f8-ab92-4c17-b728-9af684814489]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260]
Aug 27 00:59:19 user nova-compute[73458]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1, portal: 172.16.0.220,3260] successful.
Aug 27 00:59:19 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ecbc422-4625-4655-85e3-2360dbf318a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90880a2e-a2b1-4f23-949b-3531c5206c3d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] <== disconnect_volume: return (330ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 00:59:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 00:59:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:20 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'flavor' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 00:59:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d800261-742e-4bf0-8546-9c30cf90f7e5 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.747s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 00:59:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [{"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-f4f1df39-5fd2-4ede-a842-490239d576fb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:27 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 00:59:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:59:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.300617218017578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f4f1df39-5fd2-4ede-a842-490239d576fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a800258d-520b-4e76-90b4-0f7b2c8f3adc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a261c7ca-0d55-492e-8601-d5819b9d8fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 65a19ede-af2b-42a0-8987-083d081aed64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 00:59:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 00:59:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 00:59:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 00:59:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 00:59:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 00:59:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:00 user nova-compute[73458]: INFO nova.compute.manager [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Terminating instance
Aug 27 01:00:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:00:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-unplugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] No waiting events found dispatching network-vif-unplugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-9257399b-adbd-45e6-a0ed-e49b39b8dcca req-a8889e21-c54f-4ed8-9d74-094dd6fadffb service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-unplugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Instance destroyed successfully.
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lazy-loading 'resources' on Instance uuid a800258d-520b-4e76-90b4-0f7b2c8f3adc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1177357940',display_name='tempest-VolumesAdminNegativeTest-server-1177357940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1177357940',id=16,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdoCl5QNNlvIEK8BiJRZR6U1a18sucHEDN/ygFxkL/H1J4Mjd9Xul0D0JbD4358doW8Fbjh3x8Z2AmSWMe6Nnp0e1RXwDMFeR4O3ydQZouAZepbTlUTCVP5TorEkOZW0Q==',key_name='tempest-keypair-384018075',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69a956bb1b3c495b8d65db34fb63349f',ramdisk_id='',reservation_id='r-o7y0nxm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-405879464',owner_user_name='tempest-VolumesAdminNegativeTest-405879464-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38cdf950732a4f6581779ce01d3eea2c',uuid=a800258d-520b-4e76-90b4-0f7b2c8f3adc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converting VIF {"id": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "address": "fa:16:3e:c6:bc:dd", "network": {"id": "5be36229-f0ec-4603-95cf-f92e09e31b32", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-161497052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69a956bb1b3c495b8d65db34fb63349f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc71ca2d8-85", "ovs_interfaceid": "c71ca2d8-85d2-4130-8f81-88cc241c9c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG os_vif [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc71ca2d8-85, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:00:01 user nova-compute[73458]: INFO os_vif [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:bc:dd,bridge_name='br-int',has_traffic_filtering=True,id=c71ca2d8-85d2-4130-8f81-88cc241c9c66,network=Network(5be36229-f0ec-4603-95cf-f92e09e31b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc71ca2d8-85')
Aug 27 01:00:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Deleting instance files /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc_del
Aug 27 01:00:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Deletion of /opt/stack/data/nova/instances/a800258d-520b-4e76-90b4-0f7b2c8f3adc_del complete
Aug 27 01:00:01 user nova-compute[73458]: INFO nova.compute.manager [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 27 01:00:01 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:00:01 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:00:02 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Took 0.94 seconds to deallocate network for instance.
Aug 27 01:00:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:00:02 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] Acquiring lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] No waiting events found dispatching network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:03 user nova-compute[73458]: WARNING nova.compute.manager [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received unexpected event network-vif-plugged-c71ca2d8-85d2-4130-8f81-88cc241c9c66 for instance with vm_state deleted and task_state None.
Aug 27 01:00:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-a904620a-11cb-4eb0-9a77-79e009ea031e req-8abc2cb1-c500-4b02-afe8-a935e4a8eef0 service nova] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Received event network-vif-deleted-c71ca2d8-85d2-4130-8f81-88cc241c9c66 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:03 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Deleted allocations for instance a800258d-520b-4e76-90b4-0f7b2c8f3adc
Aug 27 01:00:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-56f8f3f4-ee17-4101-9216-4fe68367c9ac tempest-VolumesAdminNegativeTest-405879464 tempest-VolumesAdminNegativeTest-405879464-project-member] Lock "a800258d-520b-4e76-90b4-0f7b2c8f3adc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.527s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:05 user nova-compute[73458]: INFO nova.compute.manager [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Rescuing
Aug 27 01:00:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:00:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:00:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:06 user nova-compute[73458]: WARNING nova.compute.manager [req-7d273b28-9259-450f-a411-73ca4397e95a req-e47b9fd0-5a97-4513-b457-9e7a6aceabc7 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance destroyed successfully.
Aug 27 01:00:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Attempting rescue
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 01:00:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Creating image(s)
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue" returned: 0 in 0.061s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'migration_context' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<8377d9b5-a8c1-48be-be16-be1ace928d3f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start _get_guest_xml network_info=[{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:9e:a8:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<8377d9b5-a8c1-48be-be16-be1ace928d3f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'numa_topology' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<8377d9b5-a8c1-48be-be16-be1ace928d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:00:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:00:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<8377d9b5-a8c1-48be-be16-be1ace928d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65952474',display_name='tempest-ServerRescueNegativeTestJSON-server-65952474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-65952474',id=18,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:55:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-fep447l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T00:55:21Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=8377d9b5-a8c1-48be-be16-be1ace928d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:9e:a8:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:9e:a8:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.objects.base [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<8377d9b5-a8c1-48be-be16-be1ace928d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:00:07 user nova-compute[73458]:   <uuid>8377d9b5-a8c1-48be-be16-be1ace928d3f</uuid>
Aug 27 01:00:07 user nova-compute[73458]:   <name>instance-00000012</name>
Aug 27 01:00:07 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:00:07 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:00:07 user nova-compute[73458]:   <metadata>
Aug 27 01:00:07 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:00:07 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-65952474</nova:name>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:00:07</nova:creationTime>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:00:07 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:00:07 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:owner>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 01:00:07 user nova-compute[73458]:       </nova:owner>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:00:07 user nova-compute[73458]:       <nova:ports>
Aug 27 01:00:07 user nova-compute[73458]:         <nova:port uuid="9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9">
Aug 27 01:00:07 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 01:00:07 user nova-compute[73458]:         </nova:port>
Aug 27 01:00:07 user nova-compute[73458]:       </nova:ports>
Aug 27 01:00:07 user nova-compute[73458]:     </nova:instance>
Aug 27 01:00:07 user nova-compute[73458]:   </metadata>
Aug 27 01:00:07 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:00:07 user nova-compute[73458]:     <system>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="serial">8377d9b5-a8c1-48be-be16-be1ace928d3f</entry>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="uuid">8377d9b5-a8c1-48be-be16-be1ace928d3f</entry>
Aug 27 01:00:07 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:00:07 user nova-compute[73458]:     </system>
Aug 27 01:00:07 user nova-compute[73458]:   </sysinfo>
Aug 27 01:00:07 user nova-compute[73458]:   <os>
Aug 27 01:00:07 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:00:07 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:00:07 user nova-compute[73458]:   </os>
Aug 27 01:00:07 user nova-compute[73458]:   <features>
Aug 27 01:00:07 user nova-compute[73458]:     <acpi/>
Aug 27 01:00:07 user nova-compute[73458]:     <apic/>
Aug 27 01:00:07 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:00:07 user nova-compute[73458]:   </features>
Aug 27 01:00:07 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:00:07 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:00:07 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:00:07 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:00:07 user nova-compute[73458]:   </clock>
Aug 27 01:00:07 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:00:07 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:00:07 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:00:07 user nova-compute[73458]:   </cpu>
Aug 27 01:00:07 user nova-compute[73458]:   <devices>
Aug 27 01:00:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:00:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:00:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue"/>
Aug 27 01:00:07 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:00:07 user nova-compute[73458]:     </disk>
Aug 27 01:00:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:00:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:00:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk"/>
Aug 27 01:00:07 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 01:00:07 user nova-compute[73458]:     </disk>
Aug 27 01:00:07 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:00:07 user nova-compute[73458]:       <mac address="fa:16:3e:9e:a8:83"/>
Aug 27 01:00:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:00:07 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:00:07 user nova-compute[73458]:       <target dev="tap9de9d84c-1e"/>
Aug 27 01:00:07 user nova-compute[73458]:     </interface>
Aug 27 01:00:07 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:00:07 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/console.log" append="off"/>
Aug 27 01:00:07 user nova-compute[73458]:     </serial>
Aug 27 01:00:07 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:00:07 user nova-compute[73458]:     <video>
Aug 27 01:00:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:00:07 user nova-compute[73458]:     </video>
Aug 27 01:00:07 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:00:07 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:00:07 user nova-compute[73458]:     </rng>
Aug 27 01:00:07 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:00:07 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:00:07 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:00:07 user nova-compute[73458]:     </memballoon>
Aug 27 01:00:07 user nova-compute[73458]:   </devices>
Aug 27 01:00:07 user nova-compute[73458]: </domain>
Aug 27 01:00:07 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:00:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance destroyed successfully.
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:9e:a8:83, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:00:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:08 user nova-compute[73458]: WARNING nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:08 user nova-compute[73458]: WARNING nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:08 user nova-compute[73458]: WARNING nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:08 user nova-compute[73458]: WARNING nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:08 user nova-compute[73458]: WARNING nova.compute.manager [req-d5ec02cc-aba6-485f-8378-589298f872b4 req-88af7b5a-3cb9-423c-ae43-89974099bf72 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:09 user nova-compute[73458]: INFO nova.compute.manager [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Terminating instance
Aug 27 01:00:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Instance destroyed successfully.
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lazy-loading 'resources' on Instance uuid f4f1df39-5fd2-4ede-a842-490239d576fb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1962945541',display_name='tempest-ServerStableDeviceRescueTest-server-1962945541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1962945541',id=14,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgIu1wx5QmNGPoFJWle5oXsGIeKQQNYuSUKqf2HpCBce87wL/1qbGhHE/sHseHDQ1imPghaGIGNUpXpn45hRPDv1vZLB3iiCgcx29QKYy1SwgcVT6KOPoEJFr2cKAUcpg==',key_name='tempest-keypair-1397530717',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:57:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc97d2501a284ec79d261c526265f32b',ramdisk_id='',reservation_id='r-2djw89le',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-270201702',owner_user_name='tempest-ServerStableDeviceRescueTest-270201702-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64448af42ce44819a5ebc11f968d099e',uuid=f4f1df39-5fd2-4ede-a842-490239d576fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converting VIF {"id": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "address": "fa:16:3e:d8:e5:bd", "network": {"id": "652bf022-a719-4efe-a69a-cf9fcbb2501c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1429924460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc97d2501a284ec79d261c526265f32b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59fe0e5c-9a", "ovs_interfaceid": "59fe0e5c-9ae7-445b-b379-fbf924be540d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG os_vif [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59fe0e5c-9a, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:10 user nova-compute[73458]: INFO os_vif [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:bd,bridge_name='br-int',has_traffic_filtering=True,id=59fe0e5c-9ae7-445b-b379-fbf924be540d,network=Network(652bf022-a719-4efe-a69a-cf9fcbb2501c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59fe0e5c-9a')
Aug 27 01:00:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Deleting instance files /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb_del
Aug 27 01:00:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Deletion of /opt/stack/data/nova/instances/f4f1df39-5fd2-4ede-a842-490239d576fb_del complete
Aug 27 01:00:10 user nova-compute[73458]: INFO nova.compute.manager [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 01:00:10 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:00:10 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:11 user nova-compute[73458]: WARNING nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:11 user nova-compute[73458]: WARNING nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state rescuing.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:11 user nova-compute[73458]: WARNING nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state deleting.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:11 user nova-compute[73458]: WARNING nova.compute.manager [req-bbd7763f-4c15-474c-8967-538857f52f4d req-a796fc90-4c02-422c-a4f5-f37cc72d1df4 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state active and task_state deleting.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 8377d9b5-a8c1-48be-be16-be1ace928d3f due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098011.2237513, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Resumed (Lifecycle Event)
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-63953879-4e00-46a5-86df-b2225e5f20ae tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:00:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098011.2261238, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Started (Lifecycle Event)
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:00:11 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Took 1.09 seconds to deallocate network for instance.
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-38b8b183-e047-48c4-b364-6f63f4a7bbd3 req-1787a088-e40e-4156-b25c-3708b0593701 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-deleted-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:11 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:00:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:00:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:12 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Deleted allocations for instance f4f1df39-5fd2-4ede-a842-490239d576fb
Aug 27 01:00:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b15b5f9f-f54a-48c5-8320-b2a512a6fee3 tempest-ServerStableDeviceRescueTest-270201702 tempest-ServerStableDeviceRescueTest-270201702-project-member] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:13 user nova-compute[73458]: WARNING nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state deleted and task_state None.
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:13 user nova-compute[73458]: WARNING nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-unplugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state deleted and task_state None.
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Acquiring lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] Lock "f4f1df39-5fd2-4ede-a842-490239d576fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] No waiting events found dispatching network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:13 user nova-compute[73458]: WARNING nova.compute.manager [req-df48acfb-52bc-42a4-b151-979fcbd272cd req-594b9ba8-1e02-4edb-90c1-8f426c50b090 service nova] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Received unexpected event network-vif-plugged-59fe0e5c-9ae7-445b-b379-fbf924be540d for instance with vm_state deleted and task_state None.
Aug 27 01:00:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:16 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098001.7222335, a800258d-520b-4e76-90b4-0f7b2c8f3adc => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:16 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] VM Stopped (Lifecycle Event)
Aug 27 01:00:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7bf28627-2742-4ea0-83ba-a2d203a8dcd9 None None] [instance: a800258d-520b-4e76-90b4-0f7b2c8f3adc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:20 user nova-compute[73458]: INFO nova.compute.manager [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Detaching volume 7c946578-6315-48cb-9672-3331d4161603
Aug 27 01:00:20 user nova-compute[73458]: INFO nova.virt.block_device [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Attempting to driver detach volume 7c946578-6315-48cb-9672-3331d4161603 from mountpoint /dev/vdc
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Attempting to detach device vdc from instance a261c7ca-0d55-492e-8601-d5819b9d8fee from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:00:20 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:00:20 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:00:20 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:00:20 user nova-compute[73458]:   <serial>7c946578-6315-48cb-9672-3331d4161603</serial>
Aug 27 01:00:20 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:00:20 user nova-compute[73458]: </disk>
Aug 27 01:00:20 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:00:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully detached device vdc from instance a261c7ca-0d55-492e-8601-d5819b9d8fee from the persistent domain config.
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a261c7ca-0d55-492e-8601-d5819b9d8fee from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:00:20 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:00:20 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:00:20 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:00:20 user nova-compute[73458]:   <serial>7c946578-6315-48cb-9672-3331d4161603</serial>
Aug 27 01:00:20 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:00:20 user nova-compute[73458]: </disk>
Aug 27 01:00:20 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098020.7490497, a261c7ca-0d55-492e-8601-d5819b9d8fee => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:00:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully detached device vdc from instance a261c7ca-0d55-492e-8601-d5819b9d8fee from the live domain config.
Aug 27 01:00:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLtpKBoJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:00:20 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8823f4-5d2c-4cfc-9079-26293c3ed832]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb5320-6c7e-464c-badb-6119fb998c7a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:00:20 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 01:00:20 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 01:00:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:00:20 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 01:00:20 user nova-compute[73458]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 (non-flash)
Aug 27 01:00:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e901c76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[708891b7-5b5b-4eb0-aadb-13c382ad764c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bffdd9-0c56-4a89-963a-48faa7f51b08]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1f6a2-924b-4505-8279-1cf9a4927b40]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa80b203-d42f-472c-8a52-7775133c20f7]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af67a1-2a29-40fa-8ff7-0b33e94517e3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad35c87-fe49-4474-94bb-b98c452cadfc]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260]
Aug 27 01:00:21 user nova-compute[73458]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603, portal: 172.16.0.220,3260] successful.
Aug 27 01:00:21 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c946578-6315-48cb-9672-3331d4161603 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf3442-dfa2-4cde-abd4-068457581789]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] <== disconnect_volume: return (283ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:00:21 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'flavor' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4781ff67-4e8c-40dd-9c54-01a0400de011 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.855s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:25 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098010.466121, f4f1df39-5fd2-4ede-a842-490239d576fb => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:25 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] VM Stopped (Lifecycle Event)
Aug 27 01:00:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb659df1-3311-4fc3-8721-af3e00e57579 None None] [instance: f4f1df39-5fd2-4ede-a842-490239d576fb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:25 user nova-compute[73458]: INFO nova.compute.manager [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Unrescuing
Aug 27 01:00:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:00:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:00:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'flavor' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:26 user nova-compute[73458]: WARNING nova.compute.manager [req-4033b7e2-0cf8-4b21-9241-d612741f6fea req-2d816646-9be3-4398-aeb5-bb347dcc8a5d service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:00:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance destroyed successfully.
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:28 user nova-compute[73458]: WARNING nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:00:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:28 user nova-compute[73458]: WARNING nova.compute.manager [req-0a7c7137-b13e-4e9c-9464-59e636ec95fe req-b0a81d7a-d6a8-4465-8b52-515fa75a7f74 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:00:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-44fb5098-6946-4356-b70c-8da88ff8883b tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 85e602b0-6c12-4d09-825c-ececd08c663a due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098030.3847132, 85e602b0-6c12-4d09-825c-ececd08c663a => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Resumed (Lifecycle Event)
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098030.3850162, 85e602b0-6c12-4d09-825c-ececd08c663a => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:00:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Started (Lifecycle Event)
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:00:30 user nova-compute[73458]: WARNING nova.compute.manager [req-b081c410-8a63-41dd-bfc8-747faccd10e5 req-f3c4a394-e7e0-4913-a453-ccd37f3094ae service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state None.
Aug 27 01:00:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:00:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:00:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.414936065673828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a261c7ca-0d55-492e-8601-d5819b9d8fee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 65a19ede-af2b-42a0-8987-083d081aed64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:00:32 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:00:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:00:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updating instance_info_cache with network_info: [{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:00:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:00:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:00:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:00:46 user nova-compute[73458]: INFO nova.compute.manager [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Detaching volume 06c36210-7bfe-4b45-a531-9b514304f60a
Aug 27 01:00:46 user nova-compute[73458]: INFO nova.virt.block_device [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Attempting to driver detach volume 06c36210-7bfe-4b45-a531-9b514304f60a from mountpoint /dev/vdb
Aug 27 01:00:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Attempting to detach device vdb from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:00:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:00:46 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:00:46 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:00:46 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:00:46 user nova-compute[73458]:   <serial>06c36210-7bfe-4b45-a531-9b514304f60a</serial>
Aug 27 01:00:46 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:00:46 user nova-compute[73458]: </disk>
Aug 27 01:00:46 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:00:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully detached device vdb from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the persistent domain config.
Aug 27 01:00:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:00:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:00:46 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:00:46 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:00:46 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:00:46 user nova-compute[73458]:   <serial>06c36210-7bfe-4b45-a531-9b514304f60a</serial>
Aug 27 01:00:46 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:00:46 user nova-compute[73458]: </disk>
Aug 27 01:00:46 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098047.198617, 4d0794fa-2561-4577-bb68-08fe675d50e4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:00:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully detached device vdb from instance 4d0794fa-2561-4577-bb68-08fe675d50e4 from the live domain config.
Aug 27 01:00:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XJCLiPyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:00:47 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96089c3b-647e-490f-a261-d0e6e13722fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf71a4f0-9c34-4909-9fbc-d1383576516d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:00:47 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 01:00:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:00:47 user nova-compute[73458]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a (non-flash)
Aug 27 01:00:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e982e8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e9543-3d5c-4b30-a1bb-112e69be3871]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d58d3-84c0-47f6-9424-b6f15e20d7ba]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5ce457-552f-470a-a39f-e5f21964c8d7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7937a-1d46-4340-b6d9-a51d61590cde]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70889a5-3c27-40fe-afd9-9cfcc0298a4b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfb06c8-7f6f-425f-8976-cf5427f682c0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260]
Aug 27 01:00:47 user nova-compute[73458]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a, portal: 172.16.0.220,3260] successful.
Aug 27 01:00:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06c36210-7bfe-4b45-a531-9b514304f60a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb9e67f-a1e4-4e2e-b368-39177532c435]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== disconnect_volume: return (253ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:00:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:00:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'flavor' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:00:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c93c6659-3496-4077-8ed1-eee8a69c5019 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.775s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:00:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:00:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:10 user nova-compute[73458]: INFO nova.compute.manager [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Terminating instance
Aug 27 01:01:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4b12fed3-67a2-4de3-af9d-c5e3640e3dcb req-5b0fff75-6ba1-40e9-be72-88cf1edd4e26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-unplugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:01:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Instance destroyed successfully.
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'resources' on Instance uuid a261c7ca-0d55-492e-8601-d5819b9d8fee {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-894961662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-894961662',id=17,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2BhiUFgHSdo4/YvXrdIeWNxmJCq86bCymbFfKa01U9yO3cnwit6zjH+B4IcyUD3gCYhT5If75KDME6CdpbpKJSVrT6eH5WPgg5+IxCbIr3FvgN/LDnvOhRZbjUOFUyvg==',key_name='tempest-keypair-1066942134',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:58:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-r7y0n70o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=a261c7ca-0d55-492e-8601-d5819b9d8fee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "address": "fa:16:3e:f2:c0:4f", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc529fc8d-8b", "ovs_interfaceid": "c529fc8d-8b36-43bb-8302-f5d042c772b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG os_vif [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc529fc8d-8b, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:11 user nova-compute[73458]: INFO os_vif [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=c529fc8d-8b36-43bb-8302-f5d042c772b4,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc529fc8d-8b')
Aug 27 01:01:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Deleting instance files /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee_del
Aug 27 01:01:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Deletion of /opt/stack/data/nova/instances/a261c7ca-0d55-492e-8601-d5819b9d8fee_del complete
Aug 27 01:01:11 user nova-compute[73458]: INFO nova.compute.manager [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 01:01:11 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:01:11 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:12 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Took 0.96 seconds to deallocate network for instance.
Aug 27 01:01:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:12 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:01:12 user nova-compute[73458]: INFO nova.compute.claims [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Claim successful on node user
Aug 27 01:01:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.compute.manager [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Terminating instance
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.675s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] Acquiring lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] No waiting events found dispatching network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:13 user nova-compute[73458]: WARNING nova.compute.manager [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received unexpected event network-vif-plugged-c529fc8d-8b36-43bb-8302-f5d042c772b4 for instance with vm_state deleted and task_state None.
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-3d40f5c2-9a26-48f9-b56a-4420ea4ac7e2 req-4f6da3d8-0f47-4058-b54f-e8809c96af26 service nova] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Received event network-vif-deleted-c529fc8d-8b36-43bb-8302-f5d042c772b4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Creating image(s)
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.policy [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de7db48736b94edfa58071875ce52e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621fecd1a05149b98beae4e5591b71e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Deleted allocations for instance a261c7ca-0d55-492e-8601-d5819b9d8fee
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Instance destroyed successfully.
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lazy-loading 'resources' on Instance uuid 65a19ede-af2b-42a0-8987-083d081aed64 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-814246970',display_name='tempest-VolumesActionsTest-instance-814246970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-814246970',id=23,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:59:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53826941c0764283b9f07e4f47dcf3b9',ramdisk_id='',reservation_id='r-yi1q7fi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-149801617',owner_user_name='tempest-VolumesActionsTest-149801617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:59:15Z,user_data=None,user_id='6b72e2640d2942d0afb535151f59d755',uuid=65a19ede-af2b-42a0-8987-083d081aed64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converting VIF {"id": "85452a67-374e-474b-8682-cbea0810e962", "address": "fa:16:3e:a7:96:9e", "network": {"id": "fc44046e-31fa-4a89-a93d-337632da1d72", "bridge": "br-int", "label": "tempest-VolumesActionsTest-373656336-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53826941c0764283b9f07e4f47dcf3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85452a67-37", "ovs_interfaceid": "85452a67-374e-474b-8682-cbea0810e962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG os_vif [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85452a67-37, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.217s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:13 user nova-compute[73458]: INFO os_vif [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:9e,bridge_name='br-int',has_traffic_filtering=True,id=85452a67-374e-474b-8682-cbea0810e962,network=Network(fc44046e-31fa-4a89-a93d-337632da1d72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85452a67-37')
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Deleting instance files /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64_del
Aug 27 01:01:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Deletion of /opt/stack/data/nova/instances/65a19ede-af2b-42a0-8987-083d081aed64_del complete
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-682e06dd-e085-4493-9da8-f7c489745bcc tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "a261c7ca-0d55-492e-8601-d5819b9d8fee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.439s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk 1073741824" returned: 0 in 0.085s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:14 user nova-compute[73458]: INFO nova.compute.manager [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.242s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Cannot resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Ensure instance console log exists: /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:14 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Took 0.65 seconds to deallocate network for instance.
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-cdf02fe7-512b-4023-bdbb-7ebdf33a4a06 req-16927745-671d-4690-aae2-a4c5f9305d63 service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-deleted-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Successfully created port: 2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:15 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Deleted allocations for instance 65a19ede-af2b-42a0-8987-083d081aed64
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-unplugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] No waiting events found dispatching network-vif-unplugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:15 user nova-compute[73458]: WARNING nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received unexpected event network-vif-unplugged-85452a67-374e-474b-8682-cbea0810e962 for instance with vm_state deleted and task_state None.
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] No waiting events found dispatching network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:15 user nova-compute[73458]: WARNING nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received unexpected event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 for instance with vm_state deleted and task_state None.
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Acquiring lock "65a19ede-af2b-42a0-8987-083d081aed64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] Lock "65a19ede-af2b-42a0-8987-083d081aed64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] No waiting events found dispatching network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:15 user nova-compute[73458]: WARNING nova.compute.manager [req-2847449b-7c78-4da3-90af-c380ae2955f1 req-2360e1ba-3d49-4d7e-8711-65d0441e065a service nova] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Received unexpected event network-vif-plugged-85452a67-374e-474b-8682-cbea0810e962 for instance with vm_state deleted and task_state None.
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fa6f5b68-f13e-4dc7-9c88-146536914bed tempest-VolumesActionsTest-149801617 tempest-VolumesActionsTest-149801617-project-member] Lock "65a19ede-af2b-42a0-8987-083d081aed64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.291s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Successfully updated port: 2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:01:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance network_info: |[{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start _get_guest_xml network_info=[{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:01:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:01:16 user nova-compute[73458]:   <uuid>64b863a7-f34f-4188-be01-4a89b1248368</uuid>
Aug 27 01:01:16 user nova-compute[73458]:   <name>instance-00000018</name>
Aug 27 01:01:16 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:01:16 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:01:16 user nova-compute[73458]:   <metadata>
Aug 27 01:01:16 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:01:16 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeTestJSON-server-827951787</nova:name>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:01:16</nova:creationTime>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:01:16 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:01:16 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:owner>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:user uuid="de7db48736b94edfa58071875ce52e65">tempest-AttachVolumeTestJSON-1240035283-project-member</nova:user>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:project uuid="621fecd1a05149b98beae4e5591b71e1">tempest-AttachVolumeTestJSON-1240035283</nova:project>
Aug 27 01:01:16 user nova-compute[73458]:       </nova:owner>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:01:16 user nova-compute[73458]:       <nova:ports>
Aug 27 01:01:16 user nova-compute[73458]:         <nova:port uuid="2862faca-1049-482c-9769-5980d4bbeef3">
Aug 27 01:01:16 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 01:01:16 user nova-compute[73458]:         </nova:port>
Aug 27 01:01:16 user nova-compute[73458]:       </nova:ports>
Aug 27 01:01:16 user nova-compute[73458]:     </nova:instance>
Aug 27 01:01:16 user nova-compute[73458]:   </metadata>
Aug 27 01:01:16 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:01:16 user nova-compute[73458]:     <system>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="serial">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="uuid">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:01:16 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:01:16 user nova-compute[73458]:     </system>
Aug 27 01:01:16 user nova-compute[73458]:   </sysinfo>
Aug 27 01:01:16 user nova-compute[73458]:   <os>
Aug 27 01:01:16 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:01:16 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:01:16 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:01:16 user nova-compute[73458]:   </os>
Aug 27 01:01:16 user nova-compute[73458]:   <features>
Aug 27 01:01:16 user nova-compute[73458]:     <acpi/>
Aug 27 01:01:16 user nova-compute[73458]:     <apic/>
Aug 27 01:01:16 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:01:16 user nova-compute[73458]:   </features>
Aug 27 01:01:16 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:01:16 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:01:16 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:01:16 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:01:16 user nova-compute[73458]:   </clock>
Aug 27 01:01:16 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:01:16 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:01:16 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:01:16 user nova-compute[73458]:   </cpu>
Aug 27 01:01:16 user nova-compute[73458]:   <devices>
Aug 27 01:01:16 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:01:16 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:01:16 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk"/>
Aug 27 01:01:16 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:01:16 user nova-compute[73458]:     </disk>
Aug 27 01:01:16 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:01:16 user nova-compute[73458]:       <mac address="fa:16:3e:29:54:c6"/>
Aug 27 01:01:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:01:16 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:01:16 user nova-compute[73458]:       <target dev="tap2862faca-10"/>
Aug 27 01:01:16 user nova-compute[73458]:     </interface>
Aug 27 01:01:16 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:01:16 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/console.log" append="off"/>
Aug 27 01:01:16 user nova-compute[73458]:     </serial>
Aug 27 01:01:16 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:01:16 user nova-compute[73458]:     <video>
Aug 27 01:01:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:01:16 user nova-compute[73458]:     </video>
Aug 27 01:01:16 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:01:16 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:01:16 user nova-compute[73458]:     </rng>
Aug 27 01:01:16 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:01:16 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:01:16 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:01:16 user nova-compute[73458]:     </memballoon>
Aug 27 01:01:16 user nova-compute[73458]:   </devices>
Aug 27 01:01:16 user nova-compute[73458]: </domain>
Aug 27 01:01:16 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:01:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG os_vif [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2862faca-10, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2862faca-10, col_values=(('external_ids', {'iface-id': '2862faca-1049-482c-9769-5980d4bbeef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:54:c6', 'vm-uuid': '64b863a7-f34f-4188-be01-4a89b1248368'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:16 user nova-compute[73458]: INFO os_vif [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:01:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No VIF found with MAC fa:16:3e:29:54:c6, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-changed-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Refreshing instance network info cache due to event network-changed-2862faca-1049-482c-9769-5980d4bbeef3. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Refreshing network info cache for port 2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:18 user nova-compute[73458]: WARNING nova.compute.manager [req-3e124716-7868-441e-9b03-546676bc4c2d req-26b4e534-f2ce-436a-ae53-e9363ba9fd55 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state building and task_state spawning.
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updated VIF entry in instance network info cache for port 2862faca-1049-482c-9769-5980d4bbeef3. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e3ae9a23-1998-4465-a664-15021cccda95 req-992bc694-224c-4dfc-ba45-8b588db9aee9 service nova] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098080.0703526, 64b863a7-f34f-4188-be01-4a89b1248368 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Resumed (Lifecycle Event)
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance spawned successfully.
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098080.0716052, 64b863a7-f34f-4188-be01-4a89b1248368 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Started (Lifecycle Event)
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Took 6.77 seconds to spawn the instance on the hypervisor.
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:20 user nova-compute[73458]: WARNING nova.compute.manager [req-21c992f3-80ac-488a-87b0-241ee04d1736 req-9fcc0e2a-6b7f-4192-b1ff-dd9093ce8fd7 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state building and task_state spawning.
Aug 27 01:01:20 user nova-compute[73458]: INFO nova.compute.manager [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Took 7.88 seconds to build instance.
Aug 27 01:01:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d79aa4-adbd-4a0f-820e-63f9718b9740 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.007s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:26 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098071.2845926, a261c7ca-0d55-492e-8601-d5819b9d8fee => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:26 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] VM Stopped (Lifecycle Event)
Aug 27 01:01:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5bc14e48-1bfe-4bd2-b98d-76163d634bfc None None] [instance: a261c7ca-0d55-492e-8601-d5819b9d8fee] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098073.8241522, 65a19ede-af2b-42a0-8987-083d081aed64 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:28 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] VM Stopped (Lifecycle Event)
Aug 27 01:01:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-916a82e5-ced8-4b4d-bf96-4f6622a93600 None None] [instance: 65a19ede-af2b-42a0-8987-083d081aed64] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:28 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:30 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:01:30 user nova-compute[73458]: INFO nova.compute.claims [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Claim successful on node user
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:01:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.policy [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5706f2b84a8148fea7e3c91808d39452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791d4bc10b648919b7ac2164c0b6709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:01:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Creating image(s)
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "/opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.250s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.511s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7960MB free_disk=25.45828628540039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk 1073741824" returned: 0 in 0.054s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.571s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4d0794fa-2561-4577-bb68-08fe675d50e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Successfully created port: ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Cannot resize image /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Ensure instance console log exists: /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Successfully updated port: ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquired lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-changed-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Refreshing instance network info cache due to event network-changed-ffe3801c-9435-4d65-b825-effc5233ee2b. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] Acquiring lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updating instance_info_cache with network_info: [{"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Releasing lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Instance network_info: |[{"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] Acquired lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Refreshing network info cache for port ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Start _get_guest_xml network_info=[{"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:01:34 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:34 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-696224958',display_name='tempest-AttachVolumeNegativeTest-server-696224958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-696224958',id=25,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLk1hWHhX5HBrEvNAkeU3mRQQr/fdlWO+/FtLRQElr2TXQ8ia5AYLy+e0aI6wkB3CPIxkLNcDGH/Gv4EGJ80JksPk4tnkkaoqFJEdrAqruL7/B0tF5KcXoF6vX46q+7YQ==',key_name='tempest-keypair-1630912845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-z00v6fdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=8055c2cc-8537-4968-a051-b3fa7d2eb3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.objects.instance [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'pci_devices' on Instance uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:01:34 user nova-compute[73458]:   <uuid>8055c2cc-8537-4968-a051-b3fa7d2eb3ae</uuid>
Aug 27 01:01:34 user nova-compute[73458]:   <name>instance-00000019</name>
Aug 27 01:01:34 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:01:34 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:01:34 user nova-compute[73458]:   <metadata>
Aug 27 01:01:34 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:01:34 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeNegativeTest-server-696224958</nova:name>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:01:34</nova:creationTime>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:01:34 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:01:34 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:owner>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:user uuid="5706f2b84a8148fea7e3c91808d39452">tempest-AttachVolumeNegativeTest-643859675-project-member</nova:user>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:project uuid="b791d4bc10b648919b7ac2164c0b6709">tempest-AttachVolumeNegativeTest-643859675</nova:project>
Aug 27 01:01:34 user nova-compute[73458]:       </nova:owner>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:01:34 user nova-compute[73458]:       <nova:ports>
Aug 27 01:01:34 user nova-compute[73458]:         <nova:port uuid="ffe3801c-9435-4d65-b825-effc5233ee2b">
Aug 27 01:01:34 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 01:01:34 user nova-compute[73458]:         </nova:port>
Aug 27 01:01:34 user nova-compute[73458]:       </nova:ports>
Aug 27 01:01:34 user nova-compute[73458]:     </nova:instance>
Aug 27 01:01:34 user nova-compute[73458]:   </metadata>
Aug 27 01:01:34 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:01:34 user nova-compute[73458]:     <system>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="serial">8055c2cc-8537-4968-a051-b3fa7d2eb3ae</entry>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="uuid">8055c2cc-8537-4968-a051-b3fa7d2eb3ae</entry>
Aug 27 01:01:34 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:01:34 user nova-compute[73458]:     </system>
Aug 27 01:01:34 user nova-compute[73458]:   </sysinfo>
Aug 27 01:01:34 user nova-compute[73458]:   <os>
Aug 27 01:01:34 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:01:34 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:01:34 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:01:34 user nova-compute[73458]:   </os>
Aug 27 01:01:34 user nova-compute[73458]:   <features>
Aug 27 01:01:34 user nova-compute[73458]:     <acpi/>
Aug 27 01:01:34 user nova-compute[73458]:     <apic/>
Aug 27 01:01:34 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:01:34 user nova-compute[73458]:   </features>
Aug 27 01:01:34 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:01:34 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:01:34 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:01:34 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:01:34 user nova-compute[73458]:   </clock>
Aug 27 01:01:34 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:01:34 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:01:34 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:01:34 user nova-compute[73458]:   </cpu>
Aug 27 01:01:34 user nova-compute[73458]:   <devices>
Aug 27 01:01:34 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:01:34 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:01:34 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk"/>
Aug 27 01:01:34 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:01:34 user nova-compute[73458]:     </disk>
Aug 27 01:01:34 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:01:34 user nova-compute[73458]:       <mac address="fa:16:3e:b6:12:14"/>
Aug 27 01:01:34 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:01:34 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:01:34 user nova-compute[73458]:       <target dev="tapffe3801c-94"/>
Aug 27 01:01:34 user nova-compute[73458]:     </interface>
Aug 27 01:01:34 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:01:34 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/console.log" append="off"/>
Aug 27 01:01:34 user nova-compute[73458]:     </serial>
Aug 27 01:01:34 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:01:34 user nova-compute[73458]:     <video>
Aug 27 01:01:34 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:01:34 user nova-compute[73458]:     </video>
Aug 27 01:01:34 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:01:34 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:01:34 user nova-compute[73458]:     </rng>
Aug 27 01:01:34 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:01:34 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:01:34 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:01:34 user nova-compute[73458]:     </memballoon>
Aug 27 01:01:34 user nova-compute[73458]:   </devices>
Aug 27 01:01:34 user nova-compute[73458]: </domain>
Aug 27 01:01:34 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-696224958',display_name='tempest-AttachVolumeNegativeTest-server-696224958',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-696224958',id=25,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLk1hWHhX5HBrEvNAkeU3mRQQr/fdlWO+/FtLRQElr2TXQ8ia5AYLy+e0aI6wkB3CPIxkLNcDGH/Gv4EGJ80JksPk4tnkkaoqFJEdrAqruL7/B0tF5KcXoF6vX46q+7YQ==',key_name='tempest-keypair-1630912845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-z00v6fdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:01:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=8055c2cc-8537-4968-a051-b3fa7d2eb3ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG os_vif [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffe3801c-94, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapffe3801c-94, col_values=(('external_ids', {'iface-id': 'ffe3801c-9435-4d65-b825-effc5233ee2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:12:14', 'vm-uuid': '8055c2cc-8537-4968-a051-b3fa7d2eb3ae'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:34 user nova-compute[73458]: INFO os_vif [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94')
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:b6:12:14, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updated VIF entry in instance network info cache for port ffe3801c-9435-4d65-b825-effc5233ee2b. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updating instance_info_cache with network_info: [{"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f93851b-eb98-41fb-b26d-e445547b96a2 req-55cb3136-5f82-4bd5-b302-1046b4b3a5d9 service nova] Releasing lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] No waiting events found dispatching network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:35 user nova-compute[73458]: WARNING nova.compute.manager [req-dda1094e-7036-4cd0-970e-af32cd31ebd2 req-196f2f7e-3f75-4b79-828b-b3798e67c7ea service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received unexpected event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b for instance with vm_state building and task_state spawning.
Aug 27 01:01:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Terminating instance
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-74f870c4-8695-4790-bd62-c55514abca0c req-30233496-c71b-492d-b1e3-f3249a65f3e2 service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-unplugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Instance destroyed successfully.
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'resources' on Instance uuid 4d0794fa-2561-4577-bb68-08fe675d50e4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T00:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-696159245',display_name='tempest-ServerActionsTestOtherA-server-1313754681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-696159245',id=20,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJvJzhkLDOZtu3tczsCiEhBwkXRtNf0UTQ19I38DutRdSs8LUOvOmBypKtJJ0PLDlAqkeauareFUgpMup013MxACJhR3o6P4I28XM+wi0o2sIs9j3Y3l+NZDRRYwxRdtQ==',key_name='tempest-keypair-1851781359',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-l0nunuit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=4d0794fa-2561-4577-bb68-08fe675d50e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "address": "fa:16:3e:0d:64:50", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e1f9cd4-9e", "ovs_interfaceid": "0e1f9cd4-9e02-4736-a736-0c8056657be9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG os_vif [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e1f9cd4-9e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:37 user nova-compute[73458]: INFO os_vif [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:64:50,bridge_name='br-int',has_traffic_filtering=True,id=0e1f9cd4-9e02-4736-a736-0c8056657be9,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e1f9cd4-9e')
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Deleting instance files /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4_del
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Deletion of /opt/stack/data/nova/instances/4d0794fa-2561-4577-bb68-08fe675d50e4_del complete
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098097.8709407, 8055c2cc-8537-4968-a051-b3fa7d2eb3ae => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] VM Resumed (Lifecycle Event)
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Instance spawned successfully.
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 01:01:37 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098097.872198, 8055c2cc-8537-4968-a051-b3fa7d2eb3ae => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] VM Started (Lifecycle Event)
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 27 01:01:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:37 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:01:38 user nova-compute[73458]: INFO nova.compute.manager [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Took 7.18 seconds to build instance.
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-35db55f4-9536-469b-a4d3-7a0635605221 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.301s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] No waiting events found dispatching network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:38 user nova-compute[73458]: WARNING nova.compute.manager [req-c759b56c-807e-49d5-b781-8d5959ec6659 req-4aec9cbe-d640-43bf-a97b-1152cd9a7165 service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received unexpected event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b for instance with vm_state active and task_state None.
Aug 27 01:01:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:38 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Took 0.95 seconds to deallocate network for instance.
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:39 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Deleted allocations for instance 4d0794fa-2561-4577-bb68-08fe675d50e4
Aug 27 01:01:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8cda340-d754-4644-99fd-2ed53143c9bf tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] Acquiring lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] Lock "4d0794fa-2561-4577-bb68-08fe675d50e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] No waiting events found dispatching network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:39 user nova-compute[73458]: WARNING nova.compute.manager [req-4d3e974b-82ff-4471-9bce-4ce2b50a30cb req-93c691ec-4a0b-441c-9b7e-00997d96866c service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received unexpected event network-vif-plugged-0e1f9cd4-9e02-4736-a736-0c8056657be9 for instance with vm_state deleted and task_state None.
Aug 27 01:01:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-061bd2ec-aeba-4d7c-829c-ebefa1cd0a3a req-66517c18-f491-4347-9b22-c31ee6dd7a7f service nova] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Received event network-vif-deleted-0e1f9cd4-9e02-4736-a736-0c8056657be9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:52 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098097.8157337, 4d0794fa-2561-4577-bb68-08fe675d50e4 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:01:52 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] VM Stopped (Lifecycle Event)
Aug 27 01:01:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d00ee6a7-9f4b-4ce4-b739-caa868739db4 None None] [instance: 4d0794fa-2561-4577-bb68-08fe675d50e4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:01:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:57 user nova-compute[73458]: INFO nova.compute.manager [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Unrescuing
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'flavor' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:01:57 user nova-compute[73458]: WARNING nova.compute.manager [req-905b4302-4777-4040-a1e0-cb7156da5e28 req-c2e09a7b-3ea4-43d4-b9f3-49900d863aa3 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:01:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:58 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance destroyed successfully.
Aug 27 01:01:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:01:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:00 user nova-compute[73458]: WARNING nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:02:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:00 user nova-compute[73458]: WARNING nova.compute.manager [req-15b34b2a-f86b-4c49-90d7-5bdf65413ca9 req-53780fb6-e66b-4635-8b32-322110fcb12f service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:02:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b1248ff9-a4ba-46f9-a4df-8a51dd2a62c9 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 8377d9b5-a8c1-48be-be16-be1ace928d3f due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:02:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098121.9417768, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Resumed (Lifecycle Event)
Aug 27 01:02:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 01:02:02 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098121.9421465, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:02 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Started (Lifecycle Event)
Aug 27 01:02:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:02 user nova-compute[73458]: WARNING nova.compute.manager [req-bb236090-f59c-4381-a06f-4ee86eef32c1 req-e3a05093-8f56-4c07-8e1b-8f4cbef493f8 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state active and task_state None.
Aug 27 01:02:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:02:06 user nova-compute[73458]: INFO nova.compute.claims [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Claim successful on node user
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:02:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:02:06 user nova-compute[73458]: DEBUG nova.policy [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '017197a0401c456f97c4260b62669916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd726b2aaef554069ace63df4c4e92717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:02:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Creating image(s)
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.250s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.226s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk 1073741824" returned: 0 in 0.058s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Successfully created port: 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.264s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:02:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Cannot resize image /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Ensure instance console log exists: /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Successfully updated port: 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing instance network info cache due to event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:02:08 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance network_info: |[{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start _get_guest_xml network_info=[{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:02:09 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:09 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKybHO4sBlE9ZQP0/UdKOr+PWb5lDH3rEZXIDxVRoeNPc2IAB8zo3MRwYeFeKYrNNtFOuE7d/hyshrcCRhEFotMcShcBykIt49E1NvYewH87+/p7MY51p+w3ZDmZellbfg==',key_name='tempest-keypair-1675613778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:02:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_devices' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:02:09 user nova-compute[73458]:   <uuid>8db27216-5890-41da-8297-c8f5c36b0d33</uuid>
Aug 27 01:02:09 user nova-compute[73458]:   <name>instance-0000001a</name>
Aug 27 01:02:09 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:02:09 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:02:09 user nova-compute[73458]:   <metadata>
Aug 27 01:02:09 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:02:09 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1350033724</nova:name>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:02:09</nova:creationTime>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:02:09 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:02:09 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:owner>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:user uuid="017197a0401c456f97c4260b62669916">tempest-AttachVolumeShelveTestJSON-462549752-project-member</nova:user>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:project uuid="d726b2aaef554069ace63df4c4e92717">tempest-AttachVolumeShelveTestJSON-462549752</nova:project>
Aug 27 01:02:09 user nova-compute[73458]:       </nova:owner>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:02:09 user nova-compute[73458]:       <nova:ports>
Aug 27 01:02:09 user nova-compute[73458]:         <nova:port uuid="5ab8536e-76a7-47f7-9671-fbde015141eb">
Aug 27 01:02:09 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 01:02:09 user nova-compute[73458]:         </nova:port>
Aug 27 01:02:09 user nova-compute[73458]:       </nova:ports>
Aug 27 01:02:09 user nova-compute[73458]:     </nova:instance>
Aug 27 01:02:09 user nova-compute[73458]:   </metadata>
Aug 27 01:02:09 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:02:09 user nova-compute[73458]:     <system>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="serial">8db27216-5890-41da-8297-c8f5c36b0d33</entry>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="uuid">8db27216-5890-41da-8297-c8f5c36b0d33</entry>
Aug 27 01:02:09 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:02:09 user nova-compute[73458]:     </system>
Aug 27 01:02:09 user nova-compute[73458]:   </sysinfo>
Aug 27 01:02:09 user nova-compute[73458]:   <os>
Aug 27 01:02:09 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:02:09 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:02:09 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:02:09 user nova-compute[73458]:   </os>
Aug 27 01:02:09 user nova-compute[73458]:   <features>
Aug 27 01:02:09 user nova-compute[73458]:     <acpi/>
Aug 27 01:02:09 user nova-compute[73458]:     <apic/>
Aug 27 01:02:09 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:02:09 user nova-compute[73458]:   </features>
Aug 27 01:02:09 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:02:09 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:02:09 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:02:09 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:02:09 user nova-compute[73458]:   </clock>
Aug 27 01:02:09 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:02:09 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:02:09 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:02:09 user nova-compute[73458]:   </cpu>
Aug 27 01:02:09 user nova-compute[73458]:   <devices>
Aug 27 01:02:09 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:02:09 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:02:09 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk"/>
Aug 27 01:02:09 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:02:09 user nova-compute[73458]:     </disk>
Aug 27 01:02:09 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:02:09 user nova-compute[73458]:       <mac address="fa:16:3e:7b:b5:72"/>
Aug 27 01:02:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:02:09 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:02:09 user nova-compute[73458]:       <target dev="tap5ab8536e-76"/>
Aug 27 01:02:09 user nova-compute[73458]:     </interface>
Aug 27 01:02:09 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:02:09 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/console.log" append="off"/>
Aug 27 01:02:09 user nova-compute[73458]:     </serial>
Aug 27 01:02:09 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:02:09 user nova-compute[73458]:     <video>
Aug 27 01:02:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:02:09 user nova-compute[73458]:     </video>
Aug 27 01:02:09 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:02:09 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:02:09 user nova-compute[73458]:     </rng>
Aug 27 01:02:09 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:02:09 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:02:09 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:02:09 user nova-compute[73458]:     </memballoon>
Aug 27 01:02:09 user nova-compute[73458]:   </devices>
Aug 27 01:02:09 user nova-compute[73458]: </domain>
Aug 27 01:02:09 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKybHO4sBlE9ZQP0/UdKOr+PWb5lDH3rEZXIDxVRoeNPc2IAB8zo3MRwYeFeKYrNNtFOuE7d/hyshrcCRhEFotMcShcBykIt49E1NvYewH87+/p7MY51p+w3ZDmZellbfg==',key_name='tempest-keypair-1675613778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:02:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG os_vif [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ab8536e-76, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ab8536e-76, col_values=(('external_ids', {'iface-id': '5ab8536e-76a7-47f7-9671-fbde015141eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b5:72', 'vm-uuid': '8db27216-5890-41da-8297-c8f5c36b0d33'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:09 user nova-compute[73458]: INFO os_vif [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76')
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No VIF found with MAC fa:16:3e:7b:b5:72, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updated VIF entry in instance network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:02:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-83108340-4248-4a53-93a4-68b56f6d76bc req-22e282da-494f-4a2d-a66d-ed6e3df598c9 service nova] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:02:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:11 user nova-compute[73458]: WARNING nova.compute.manager [req-76a2cff4-d647-4de0-b551-0280275749fc req-333c17fc-acbd-461c-b008-34bf854189f1 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state building and task_state spawning.
Aug 27 01:02:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098132.8764725, 8db27216-5890-41da-8297-c8f5c36b0d33 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Resumed (Lifecycle Event)
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:02:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance spawned successfully.
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098132.8800027, 8db27216-5890-41da-8297-c8f5c36b0d33 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Started (Lifecycle Event)
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:02:13 user nova-compute[73458]: INFO nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 27 01:02:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:13 user nova-compute[73458]: INFO nova.compute.manager [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Took 6.91 seconds to build instance.
Aug 27 01:02:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-df6c5b1d-9bd9-42f7-ab43-63f3f87b7940 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:13 user nova-compute[73458]: WARNING nova.compute.manager [req-e5559baa-fd05-4151-af1c-dbbb8ec10d05 req-eb7a7b5c-be49-49ae-9868-bbf25c91bfec service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state active and task_state None.
Aug 27 01:02:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:02:17 user nova-compute[73458]: INFO nova.compute.claims [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Claim successful on node user
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:02:18 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.policy [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a452f9412de4c8d881d30b02c01d3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3537b33489d84282958ddf05f58ade1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:02:18 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Creating image(s)
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "/opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk 1073741824" returned: 0 in 0.061s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.203s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Cannot resize image /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Ensure instance console log exists: /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Successfully created port: bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Successfully updated port: bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-changed-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Refreshing instance network info cache due to event network-changed-bb640dcd-c880-4c6e-89ff-06f5a6d75b09. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] Acquiring lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:02:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updating instance_info_cache with network_info: [{"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance network_info: |[{"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] Acquired lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.neutron [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Refreshing network info cache for port bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Start _get_guest_xml network_info=[{"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:02:21 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:21 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1737038114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1737038114',id=27,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-dvnozewq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:02:19Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=251d68d6-f239-4bcd-844a-cd0833a09d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 251d68d6-f239-4bcd-844a-cd0833a09d0e {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:02:21 user nova-compute[73458]:   <uuid>251d68d6-f239-4bcd-844a-cd0833a09d0e</uuid>
Aug 27 01:02:21 user nova-compute[73458]:   <name>instance-0000001b</name>
Aug 27 01:02:21 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:02:21 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:02:21 user nova-compute[73458]:   <metadata>
Aug 27 01:02:21 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:02:21 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1737038114</nova:name>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:02:21</nova:creationTime>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:02:21 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:02:21 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:owner>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 01:02:21 user nova-compute[73458]:       </nova:owner>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:02:21 user nova-compute[73458]:       <nova:ports>
Aug 27 01:02:21 user nova-compute[73458]:         <nova:port uuid="bb640dcd-c880-4c6e-89ff-06f5a6d75b09">
Aug 27 01:02:21 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 01:02:21 user nova-compute[73458]:         </nova:port>
Aug 27 01:02:21 user nova-compute[73458]:       </nova:ports>
Aug 27 01:02:21 user nova-compute[73458]:     </nova:instance>
Aug 27 01:02:21 user nova-compute[73458]:   </metadata>
Aug 27 01:02:21 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:02:21 user nova-compute[73458]:     <system>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="serial">251d68d6-f239-4bcd-844a-cd0833a09d0e</entry>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="uuid">251d68d6-f239-4bcd-844a-cd0833a09d0e</entry>
Aug 27 01:02:21 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:02:21 user nova-compute[73458]:     </system>
Aug 27 01:02:21 user nova-compute[73458]:   </sysinfo>
Aug 27 01:02:21 user nova-compute[73458]:   <os>
Aug 27 01:02:21 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:02:21 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:02:21 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:02:21 user nova-compute[73458]:   </os>
Aug 27 01:02:21 user nova-compute[73458]:   <features>
Aug 27 01:02:21 user nova-compute[73458]:     <acpi/>
Aug 27 01:02:21 user nova-compute[73458]:     <apic/>
Aug 27 01:02:21 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:02:21 user nova-compute[73458]:   </features>
Aug 27 01:02:21 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:02:21 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:02:21 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:02:21 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:02:21 user nova-compute[73458]:   </clock>
Aug 27 01:02:21 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:02:21 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:02:21 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:02:21 user nova-compute[73458]:   </cpu>
Aug 27 01:02:21 user nova-compute[73458]:   <devices>
Aug 27 01:02:21 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:02:21 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:02:21 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk"/>
Aug 27 01:02:21 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:02:21 user nova-compute[73458]:     </disk>
Aug 27 01:02:21 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:02:21 user nova-compute[73458]:       <mac address="fa:16:3e:5c:83:81"/>
Aug 27 01:02:21 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:02:21 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:02:21 user nova-compute[73458]:       <target dev="tapbb640dcd-c8"/>
Aug 27 01:02:21 user nova-compute[73458]:     </interface>
Aug 27 01:02:21 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:02:21 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/console.log" append="off"/>
Aug 27 01:02:21 user nova-compute[73458]:     </serial>
Aug 27 01:02:21 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:02:21 user nova-compute[73458]:     <video>
Aug 27 01:02:21 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:02:21 user nova-compute[73458]:     </video>
Aug 27 01:02:21 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:02:21 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:02:21 user nova-compute[73458]:     </rng>
Aug 27 01:02:21 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:02:21 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:02:21 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:02:21 user nova-compute[73458]:     </memballoon>
Aug 27 01:02:21 user nova-compute[73458]:   </devices>
Aug 27 01:02:21 user nova-compute[73458]: </domain>
Aug 27 01:02:21 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1737038114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1737038114',id=27,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-dvnozewq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:02:19Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=251d68d6-f239-4bcd-844a-cd0833a09d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG os_vif [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb640dcd-c8, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb640dcd-c8, col_values=(('external_ids', {'iface-id': 'bb640dcd-c880-4c6e-89ff-06f5a6d75b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:83:81', 'vm-uuid': '251d68d6-f239-4bcd-844a-cd0833a09d0e'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:21 user nova-compute[73458]: INFO os_vif [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8')
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:5c:83:81, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.neutron [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updated VIF entry in instance network info cache for port bb640dcd-c880-4c6e-89ff-06f5a6d75b09. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG nova.network.neutron [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updating instance_info_cache with network_info: [{"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:02:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34b56215-58dd-4247-ab46-14cfeff2cb48 req-4ed27c98-0cef-4b24-ab17-7f0e10b782cd service nova] Releasing lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] No waiting events found dispatching network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:22 user nova-compute[73458]: WARNING nova.compute.manager [req-03825b84-234c-44fd-a1ed-2155f0f8284a req-59ec6a03-ad79-438e-8363-4812be0455e0 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received unexpected event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 for instance with vm_state building and task_state spawning.
Aug 27 01:02:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098144.9025204, 251d68d6-f239-4bcd-844a-cd0833a09d0e => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:24 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] VM Resumed (Lifecycle Event)
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:02:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance spawned successfully.
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] No waiting events found dispatching network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:02:25 user nova-compute[73458]: WARNING nova.compute.manager [req-a35dfed2-bac9-4ff9-a421-0f29b154df20 req-acd8d3cb-c6d9-4e3c-9aef-9c26e8e15249 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received unexpected event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 for instance with vm_state building and task_state spawning.
Aug 27 01:02:25 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098144.9059784, 251d68d6-f239-4bcd-844a-cd0833a09d0e => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:02:25 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] VM Started (Lifecycle Event)
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:02:25 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:02:25 user nova-compute[73458]: INFO nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 27 01:02:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:02:25 user nova-compute[73458]: INFO nova.compute.manager [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Took 7.75 seconds to build instance.
Aug 27 01:02:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a8709d38-dd92-4fae-b91c-ae7d8c46c8e7 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.886s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:02:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:02:33 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:33 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7706MB free_disk=25.397613525390625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8db27216-5890-41da-8297-c8f5c36b0d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:02:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:02:34 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:02:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:02:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:02:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:02:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-changed-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Refreshing instance network info cache due to event network-changed-2862faca-1049-482c-9769-5980d4bbeef3. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Refreshing network info cache for port 2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updated VIF entry in instance network info cache for port 2862faca-1049-482c-9769-5980d4bbeef3. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:04 user nova-compute[73458]: DEBUG nova.network.neutron [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-687cf015-eac1-4434-b83f-b55292ad5d3c req-977a761c-cb73-492e-b653-11a70b19d512 service nova] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:08 user nova-compute[73458]: INFO nova.compute.manager [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Attaching volume cf681136-6dc4-4202-978b-15e6b267aac1 to /dev/vdb
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.utils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce37717-f637-4f5e-bbe2-358b4a5e06b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[104aa8a9-0126-434b-8dd5-05f5cce5144d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec93c0d-b562-4a0e-bdd9-e6e37afb54b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d824a1-1b98-4a2b-b59b-667497ecca1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:09 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:03:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7bb1e-1d37-40c2-81d3-f16fdef9877e]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG os_brick.utils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:09 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating existing volume attachment record: 05801e0e-e1d8-4d06-a086-14d736c16f7f {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:03:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:20 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:20 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:20 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9ffc0-474a-4c96-aed6-b4e303f72b14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:03:20 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbb5f8-f815-4998-a53b-1afe84a1efe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1] added
Aug 27 01:03:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[011fc960-c805-4bd3-904d-10f87ae20827]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775afb6-1c90-463e-88f3-121fe72bbafb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvtJsjWT {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvtJsjWT" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da1f61-4ec7-4991-8516-1599f1cade5a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvtJsjWT'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[29754a63-c626-4b06-a553-1fc5dc07f2f3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a4736f-479c-4277-8730-21242fb15a7c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacfdb03-4672-404b-bb52-1dabc0a4031e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]
Aug 27 01:03:21 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.
Aug 27 01:03:21 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba3bc8-5d73-4dbb-a186-89092e1058dc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7bebaf-8fde-4a89-a075-e92955836b23]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:21 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:21 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:21 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:21 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f5cee-1174-4ff8-875c-bef14ed236ab]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:21 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-changed-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Refreshing instance network info cache due to event network-changed-ffe3801c-9435-4d65-b825-effc5233ee2b. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] Acquiring lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] Acquired lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Refreshing network info cache for port ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.300s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== connect_volume: return (2302ms) {'type': 'block', 'scsi_wwn': '26462316364343733', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462316364343733', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updated VIF entry in instance network info cache for port ffe3801c-9435-4d65-b825-effc5233ee2b. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updating instance_info_cache with network_info: [{"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.objects.instance [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-cb6f4eaf-1b4c-41fb-9555-a51ed26d515c req-76069728-df88-429e-9595-8bbc3307100c service nova] Releasing lock "refresh_cache-8055c2cc-8537-4968-a051-b3fa7d2eb3ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:03:22 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:03:22 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:03:22 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:03:22 user nova-compute[73458]:   <serial>cf681136-6dc4-4202-978b-15e6b267aac1</serial>
Aug 27 01:03:22 user nova-compute[73458]: </disk>
Aug 27 01:03:22 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:03:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No VIF found with MAC fa:16:3e:29:54:c6, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:03:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-816e1f6d-d7bf-4706-8a33-2b6569620d70 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.391s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.005s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73458) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG nova.objects.instance [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance destroyed successfully.
Aug 27 01:03:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04937a7a-8cd8-45ac-9031-4a6e1aa17e2d tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:03:25 user nova-compute[73458]: WARNING nova.compute.manager [req-b775c8b2-8987-4fbc-a2d0-837f99aba9fb req-131c24bb-0db9-4717-ba69-0b9961bd6f5e service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state None.
Aug 27 01:03:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:27 user nova-compute[73458]: INFO nova.compute.manager [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Attaching volume bcdf422e-ede0-4864-983f-646bf05f6627 to /dev/vdb
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.utils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c69e7-5a12-4108-aa79-89ad2634331d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1edacab-fe48-41ca-8701-fb459e70a63e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee84c0b-9065-44f3-be80-51f916bc30e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed595ce-83dc-4919-9478-bc8d514bc985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:27 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f530519-8a5f-442f-a1e3-95967c3ac599]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG os_brick.utils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updating existing volume attachment record: 89af071a-250c-4ac9-b088-7728bb083af1 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:27 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:03:27 user nova-compute[73458]: WARNING nova.compute.manager [req-a8ec5ca7-01a5-4099-9184-647eb578c810 req-6c8f56be-3d41-417a-a975-46d1e41223da service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state None.
Aug 27 01:03:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:03:29 user nova-compute[73458]: INFO nova.compute.claims [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Claim successful on node user
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:29 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:03:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.policy [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34490a3d9e9f44b48df7d2c4082e48f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00575e7e8e7745f1ba0a0045aed0a413', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:03:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Creating image(s)
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "/opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "/opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "/opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk 1073741824" returned: 0 in 0.070s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Successfully created port: 7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:03:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Cannot resize image /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Ensure instance console log exists: /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Successfully updated port: 7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquired lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-changed-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Refreshing instance network info cache due to event network-changed-7505a9ae-0f36-4387-b971-1e34f396150e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] Acquiring lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updating instance_info_cache with network_info: [{"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Releasing lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Instance network_info: |[{"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] Acquired lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Refreshing network info cache for port 7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Start _get_guest_xml network_info=[{"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:03:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:32 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962389',id=28,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkR31ZV0TKbDYohJkLQQfMVDz/uoSkKv5lfbx8w4Cfp+f6P79RyqcxRQ1sve2x6e626E6SI/IK62P89A+I1fBvHAd3t+ySC0giMSaA8eW/w8IGMzeX3oGrAYS3gsamG3A==',key_name='tempest-keypair-178097356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00575e7e8e7745f1ba0a0045aed0a413',ramdisk_id='',reservation_id='r-vg2z5ks5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34490a3d9e9f44b48df7d2c4082e48f9',uuid=4571e0b0-c12a-407c-845e-67bc2a7480bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converting VIF {"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.objects.instance [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lazy-loading 'pci_devices' on Instance uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:03:32 user nova-compute[73458]:   <uuid>4571e0b0-c12a-407c-845e-67bc2a7480bb</uuid>
Aug 27 01:03:32 user nova-compute[73458]:   <name>instance-0000001c</name>
Aug 27 01:03:32 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:03:32 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:03:32 user nova-compute[73458]:   <metadata>
Aug 27 01:03:32 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:03:32 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743</nova:name>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:03:32</nova:creationTime>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:03:32 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:03:32 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:owner>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:user uuid="34490a3d9e9f44b48df7d2c4082e48f9">tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member</nova:user>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:project uuid="00575e7e8e7745f1ba0a0045aed0a413">tempest-TestServerVolumeAttachScenarioOldVersion-1209232957</nova:project>
Aug 27 01:03:32 user nova-compute[73458]:       </nova:owner>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:03:32 user nova-compute[73458]:       <nova:ports>
Aug 27 01:03:32 user nova-compute[73458]:         <nova:port uuid="7505a9ae-0f36-4387-b971-1e34f396150e">
Aug 27 01:03:32 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 01:03:32 user nova-compute[73458]:         </nova:port>
Aug 27 01:03:32 user nova-compute[73458]:       </nova:ports>
Aug 27 01:03:32 user nova-compute[73458]:     </nova:instance>
Aug 27 01:03:32 user nova-compute[73458]:   </metadata>
Aug 27 01:03:32 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:03:32 user nova-compute[73458]:     <system>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="serial">4571e0b0-c12a-407c-845e-67bc2a7480bb</entry>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="uuid">4571e0b0-c12a-407c-845e-67bc2a7480bb</entry>
Aug 27 01:03:32 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:03:32 user nova-compute[73458]:     </system>
Aug 27 01:03:32 user nova-compute[73458]:   </sysinfo>
Aug 27 01:03:32 user nova-compute[73458]:   <os>
Aug 27 01:03:32 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:03:32 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:03:32 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:03:32 user nova-compute[73458]:   </os>
Aug 27 01:03:32 user nova-compute[73458]:   <features>
Aug 27 01:03:32 user nova-compute[73458]:     <acpi/>
Aug 27 01:03:32 user nova-compute[73458]:     <apic/>
Aug 27 01:03:32 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:03:32 user nova-compute[73458]:   </features>
Aug 27 01:03:32 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:03:32 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:03:32 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:03:32 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:03:32 user nova-compute[73458]:   </clock>
Aug 27 01:03:32 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:03:32 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:03:32 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:03:32 user nova-compute[73458]:   </cpu>
Aug 27 01:03:32 user nova-compute[73458]:   <devices>
Aug 27 01:03:32 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:03:32 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:03:32 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk"/>
Aug 27 01:03:32 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:03:32 user nova-compute[73458]:     </disk>
Aug 27 01:03:32 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:03:32 user nova-compute[73458]:       <mac address="fa:16:3e:55:a4:66"/>
Aug 27 01:03:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:32 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:03:32 user nova-compute[73458]:       <target dev="tap7505a9ae-0f"/>
Aug 27 01:03:32 user nova-compute[73458]:     </interface>
Aug 27 01:03:32 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:03:32 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/console.log" append="off"/>
Aug 27 01:03:32 user nova-compute[73458]:     </serial>
Aug 27 01:03:32 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:03:32 user nova-compute[73458]:     <video>
Aug 27 01:03:32 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:32 user nova-compute[73458]:     </video>
Aug 27 01:03:32 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:03:32 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:03:32 user nova-compute[73458]:     </rng>
Aug 27 01:03:32 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:03:32 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:03:32 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:03:32 user nova-compute[73458]:     </memballoon>
Aug 27 01:03:32 user nova-compute[73458]:   </devices>
Aug 27 01:03:32 user nova-compute[73458]: </domain>
Aug 27 01:03:32 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962389',id=28,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkR31ZV0TKbDYohJkLQQfMVDz/uoSkKv5lfbx8w4Cfp+f6P79RyqcxRQ1sve2x6e626E6SI/IK62P89A+I1fBvHAd3t+ySC0giMSaA8eW/w8IGMzeX3oGrAYS3gsamG3A==',key_name='tempest-keypair-178097356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00575e7e8e7745f1ba0a0045aed0a413',ramdisk_id='',reservation_id='r-vg2z5ks5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34490a3d9e9f44b48df7d2c4082e48f9',uuid=4571e0b0-c12a-407c-845e-67bc2a7480bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converting VIF {"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG os_vif [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7505a9ae-0f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7505a9ae-0f, col_values=(('external_ids', {'iface-id': '7505a9ae-0f36-4387-b971-1e34f396150e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:a4:66', 'vm-uuid': '4571e0b0-c12a-407c-845e-67bc2a7480bb'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:32 user nova-compute[73458]: INFO os_vif [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f')
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] No VIF found with MAC fa:16:3e:55:a4:66, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.network.neutron [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updated VIF entry in instance network info cache for port 7505a9ae-0f36-4387-b971-1e34f396150e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.network.neutron [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updating instance_info_cache with network_info: [{"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-df7fca38-11c0-4890-9d39-2c6d526d0d0c req-49516a0d-9349-4e66-99eb-55133da3c4bf service nova] Releasing lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:33 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:33 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.355899810791016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8db27216-5890-41da-8297-c8f5c36b0d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4571e0b0-c12a-407c-845e-67bc2a7480bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:03:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] No waiting events found dispatching network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:03:34 user nova-compute[73458]: WARNING nova.compute.manager [req-dcf1a343-1e55-410e-b96d-ccd0602ee11b req-9f30f361-9cdc-40a8-b3fe-cdbb68827ffb service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received unexpected event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e for instance with vm_state building and task_state spawning.
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098216.5204217, 4571e0b0-c12a-407c-845e-67bc2a7480bb => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] VM Resumed (Lifecycle Event)
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Instance spawned successfully.
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] No waiting events found dispatching network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:03:36 user nova-compute[73458]: WARNING nova.compute.manager [req-f01d98d1-0de1-48bf-9d79-6bfe12009cc5 req-ecee76ff-f912-44d9-bd27-126bc38ea346 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received unexpected event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e for instance with vm_state building and task_state spawning.
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098216.525307, 4571e0b0-c12a-407c-845e-67bc2a7480bb => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] VM Started (Lifecycle Event)
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 27 01:03:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:36 user nova-compute[73458]: INFO nova.compute.manager [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Took 7.27 seconds to build instance.
Aug 27 01:03:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-20bbce59-f429-45fd-84ca-66e18f85e000 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.372s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:03:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:03:39 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098204.8849165, 64b863a7-f34f-4188-be01-4a89b1248368 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:03:39 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Stopped (Lifecycle Event)
Aug 27 01:03:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2c145adf-e36c-4b80-ae9d-8955dfc72dd3 None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:03:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2c145adf-e36c-4b80-ae9d-8955dfc72dd3 None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:03:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:43 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:03:43 user nova-compute[73458]: INFO nova.compute.claims [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Claim successful on node user
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:03:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:03:44 user nova-compute[73458]: INFO nova.virt.block_device [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Booting with volume 5c17661c-fd79-4eea-9d14-238851853550 at /dev/vda
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.utils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db97254c-6696-41dd-95c5-a4c3d4428492]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563eedd-38c4-4578-b943-e040840d832c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2ac97-90f8-43b9-b21f-236192536577]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef94af2-925e-4d30-862f-3bce576e2f57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.policy [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15e8844b6f594cef9e904b88a6ca42b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd605e8ac6e749718ba402ae385a24bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:03:44 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:03:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[840dac29-4354-4bb3-9ebb-22883001d211]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG os_brick.utils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:44 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating existing volume attachment record: ad8c7052-2cfa-48c2-b9fe-886c01014404 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Successfully created port: 0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcIvpYXb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:46 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:46 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:46 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4670ede5-f309-4619-bc16-ac075c093ed4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:03:46 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a41a919-a56c-406a-8056-33ab2c982e23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627] added
Aug 27 01:03:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ee89c-c9a4-4997-93cd-c58366fd8320]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861b390-0320-4cea-a24f-fcb361936407]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcIvpYXb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zcIvpYXb" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ad1abd-64f9-42f0-82f1-040862f05896]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zcIvpYXb'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3521fc9-b756-441b-8013-608fdfe77916]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb970a72-1ae0-4838-be87-366279378f8e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5268cdb8-3fd7-40e4-bdc0-c5061acf9eb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260]
Aug 27 01:03:47 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260] successful.
Aug 27 01:03:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72d863-6661-40a2-a174-7ae66565aa33]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfe6773-02be-40da-9864-fd9b913efb5d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[985fe4be-4a73-4560-9b97-9820656c565f]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcIvpYXb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Successfully updated port: 0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-changed-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Refreshing instance network info cache due to event network-changed-0d59c227-d91a-4bac-ad34-26bb8498cb56. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23464333634393561', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464333634393561', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:03:48 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:03:48 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:03:48 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:03:48 user nova-compute[73458]:   <serial>bcdf422e-ede0-4864-983f-646bf05f6627</serial>
Aug 27 01:03:48 user nova-compute[73458]: </disk>
Aug 27 01:03:48 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance network_info: |[{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Refreshing network info cache for port 0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:b6:12:14, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updated VIF entry in instance network info cache for port 0d59c227-d91a-4bac-ad34-26bb8498cb56. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4507055e-3501-4abe-8860-381a498fc254 req-c73415b8-b16c-4f79-9715-6466cb27d8c5 service nova] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a829205-f4fe-46e6-8b28-5c8c79ee72a7 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.892s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:03:53 user nova-compute[73458]: INFO nova.compute.claims [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Claim successful on node user
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.policy [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5706f2b84a8148fea7e3c91808d39452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791d4bc10b648919b7ac2164c0b6709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:03:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Creating image(s)
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk 1073741824" returned: 0 in 0.068s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Successfully created port: 9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Cannot resize image /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Ensure instance console log exists: /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Successfully updated port: 9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquired lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-changed-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Refreshing instance network info cache due to event network-changed-9e320894-5cc8-4ef4-b2bf-e665a22d5168. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] Acquiring lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updating instance_info_cache with network_info: [{"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Releasing lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Instance network_info: |[{"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] Acquired lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Refreshing network info cache for port 9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Start _get_guest_xml network_info=[{"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:03:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320784007',display_name='tempest-AttachVolumeNegativeTest-server-1320784007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320784007',id=30,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1JVxp34H+TMDu7VqLkNGBd9/dx9E0VF2SA9F5b5rZWVXH4j/pwOXvSdy2BkABEs7v1Qb8PZGnRMLpJJMImPwKrWtQpF+plgmeBKxWj86UaxzCCfE5WRgh2mANfapSxw==',key_name='tempest-keypair-1548115037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-bn9qoy80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=aa2f396e-4858-4404-960a-66589a1fa275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.objects.instance [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'pci_devices' on Instance uuid aa2f396e-4858-4404-960a-66589a1fa275 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:03:56 user nova-compute[73458]:   <uuid>aa2f396e-4858-4404-960a-66589a1fa275</uuid>
Aug 27 01:03:56 user nova-compute[73458]:   <name>instance-0000001e</name>
Aug 27 01:03:56 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:03:56 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:03:56 user nova-compute[73458]:   <metadata>
Aug 27 01:03:56 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:03:56 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1320784007</nova:name>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:03:56</nova:creationTime>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:03:56 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:03:56 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:owner>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:user uuid="5706f2b84a8148fea7e3c91808d39452">tempest-AttachVolumeNegativeTest-643859675-project-member</nova:user>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:project uuid="b791d4bc10b648919b7ac2164c0b6709">tempest-AttachVolumeNegativeTest-643859675</nova:project>
Aug 27 01:03:56 user nova-compute[73458]:       </nova:owner>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:03:56 user nova-compute[73458]:       <nova:ports>
Aug 27 01:03:56 user nova-compute[73458]:         <nova:port uuid="9e320894-5cc8-4ef4-b2bf-e665a22d5168">
Aug 27 01:03:56 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:03:56 user nova-compute[73458]:         </nova:port>
Aug 27 01:03:56 user nova-compute[73458]:       </nova:ports>
Aug 27 01:03:56 user nova-compute[73458]:     </nova:instance>
Aug 27 01:03:56 user nova-compute[73458]:   </metadata>
Aug 27 01:03:56 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:03:56 user nova-compute[73458]:     <system>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="serial">aa2f396e-4858-4404-960a-66589a1fa275</entry>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="uuid">aa2f396e-4858-4404-960a-66589a1fa275</entry>
Aug 27 01:03:56 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:03:56 user nova-compute[73458]:     </system>
Aug 27 01:03:56 user nova-compute[73458]:   </sysinfo>
Aug 27 01:03:56 user nova-compute[73458]:   <os>
Aug 27 01:03:56 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:03:56 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:03:56 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:03:56 user nova-compute[73458]:   </os>
Aug 27 01:03:56 user nova-compute[73458]:   <features>
Aug 27 01:03:56 user nova-compute[73458]:     <acpi/>
Aug 27 01:03:56 user nova-compute[73458]:     <apic/>
Aug 27 01:03:56 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:03:56 user nova-compute[73458]:   </features>
Aug 27 01:03:56 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:03:56 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:03:56 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:03:56 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:03:56 user nova-compute[73458]:   </clock>
Aug 27 01:03:56 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:03:56 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:03:56 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:03:56 user nova-compute[73458]:   </cpu>
Aug 27 01:03:56 user nova-compute[73458]:   <devices>
Aug 27 01:03:56 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:03:56 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:03:56 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk"/>
Aug 27 01:03:56 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:03:56 user nova-compute[73458]:     </disk>
Aug 27 01:03:56 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:03:56 user nova-compute[73458]:       <mac address="fa:16:3e:7e:79:cc"/>
Aug 27 01:03:56 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:56 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:03:56 user nova-compute[73458]:       <target dev="tap9e320894-5c"/>
Aug 27 01:03:56 user nova-compute[73458]:     </interface>
Aug 27 01:03:56 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:03:56 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/console.log" append="off"/>
Aug 27 01:03:56 user nova-compute[73458]:     </serial>
Aug 27 01:03:56 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:03:56 user nova-compute[73458]:     <video>
Aug 27 01:03:56 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:56 user nova-compute[73458]:     </video>
Aug 27 01:03:56 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:03:56 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:03:56 user nova-compute[73458]:     </rng>
Aug 27 01:03:56 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:03:56 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:03:56 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:03:56 user nova-compute[73458]:     </memballoon>
Aug 27 01:03:56 user nova-compute[73458]:   </devices>
Aug 27 01:03:56 user nova-compute[73458]: </domain>
Aug 27 01:03:56 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320784007',display_name='tempest-AttachVolumeNegativeTest-server-1320784007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320784007',id=30,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1JVxp34H+TMDu7VqLkNGBd9/dx9E0VF2SA9F5b5rZWVXH4j/pwOXvSdy2BkABEs7v1Qb8PZGnRMLpJJMImPwKrWtQpF+plgmeBKxWj86UaxzCCfE5WRgh2mANfapSxw==',key_name='tempest-keypair-1548115037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-bn9qoy80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=aa2f396e-4858-4404-960a-66589a1fa275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG os_vif [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e320894-5c, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e320894-5c, col_values=(('external_ids', {'iface-id': '9e320894-5cc8-4ef4-b2bf-e665a22d5168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:79:cc', 'vm-uuid': 'aa2f396e-4858-4404-960a-66589a1fa275'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:56 user nova-compute[73458]: INFO os_vif [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c')
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:7e:79:cc, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:03:57 user nova-compute[73458]: INFO nova.compute.claims [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Claim successful on node user
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing instance network info cache due to event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updated VIF entry in instance network info cache for port 9e320894-5cc8-4ef4-b2bf-e665a22d5168. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updating instance_info_cache with network_info: [{"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0eb2c315-2b26-4360-ae62-f826f4ca58bf req-982aa1a9-96bb-4d5b-b97f-89bfd18fdb42 service nova] Releasing lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.742s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:03:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Creating image(s)
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start _get_guest_xml network_info=[{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27d4df7e-e2e2-4292-9a18-ae984b3be6a0', 'attached_at': '', 'detached_at': '', 'volume_id': '5c17661c-fd79-4eea-9d14-238851853550', 'serial': '5c17661c-fd79-4eea-9d14-238851853550'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'ad8c7052-2cfa-48c2-b9fe-886c01014404', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:03:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:03:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:03:57 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9568949c-ae26-4a27-b954-be0508e74ecf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:03:57 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4281522e-6c31-45aa-acfd-2289fe91012f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550] added
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc320bd-bdc2-4b03-a24e-f1bf8d597fe7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbe1c66-9333-47ec-afe9-61c6668997f2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfOaEUBm {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfOaEUBm" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b586b-dfa0-4681-a124-5d328732e229]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfOaEUBm'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f915ed-a0d3-4f1c-b752-478e5295afa6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:03:58 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Creating image(s)
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[27badcb9-6301-4d0b-8633-5a8478516c2a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c918295-cc5b-49a6-82a6-8684c8bc9124]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]
Aug 27 01:03:58 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dfc26d-fb16-4370-9b87-f81e61393779]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a87d1-ee61-4c71-ae00-31e3a2dca348]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:03:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.network.neutron [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updated VIF entry in instance network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.network.neutron [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eedeae-fdf6-4e0a-8cd8-a41725da8eb4]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1ec13c1a-1a1c-404f-9c5f-487b290c4930 req-060b7e80-5cab-421c-ade3-3779637c7454 service nova] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.policy [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1a7573d764b4cc0a7af57c45323c4f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd1972e3c8fd486bac81a90b489714ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.290s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.267s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] No waiting events found dispatching network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:03:58 user nova-compute[73458]: WARNING nova.compute.manager [req-901b3864-6587-4c2c-b68f-d91869638c9f req-881e0a4f-52c4-4da4-9698-88bed33b59f5 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received unexpected event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 for instance with vm_state building and task_state spawning.
Aug 27 01:03:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk 1073741824" returned: 0 in 0.156s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.428s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.255s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Cannot resize image /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Ensure instance console log exists: /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23435323435373230', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435323435373230', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'pci_devices' on Instance uuid 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:03:59 user nova-compute[73458]:   <uuid>27d4df7e-e2e2-4292-9a18-ae984b3be6a0</uuid>
Aug 27 01:03:59 user nova-compute[73458]:   <name>instance-0000001d</name>
Aug 27 01:03:59 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:03:59 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:03:59 user nova-compute[73458]:   <metadata>
Aug 27 01:03:59 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:03:59 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:03:59 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherA-server-414505967</nova:name>
Aug 27 01:03:59 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:03:57</nova:creationTime>
Aug 27 01:03:59 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:03:59 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:03:59 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:03:59 user nova-compute[73458]:       <nova:owner>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:user uuid="15e8844b6f594cef9e904b88a6ca42b9">tempest-ServerActionsTestOtherA-1449025138-project-member</nova:user>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:project uuid="bd605e8ac6e749718ba402ae385a24bd">tempest-ServerActionsTestOtherA-1449025138</nova:project>
Aug 27 01:03:59 user nova-compute[73458]:       </nova:owner>
Aug 27 01:03:59 user nova-compute[73458]:       <nova:ports>
Aug 27 01:03:59 user nova-compute[73458]:         <nova:port uuid="0d59c227-d91a-4bac-ad34-26bb8498cb56">
Aug 27 01:03:59 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:03:59 user nova-compute[73458]:         </nova:port>
Aug 27 01:03:59 user nova-compute[73458]:       </nova:ports>
Aug 27 01:03:59 user nova-compute[73458]:     </nova:instance>
Aug 27 01:03:59 user nova-compute[73458]:   </metadata>
Aug 27 01:03:59 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:03:59 user nova-compute[73458]:     <system>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="serial">27d4df7e-e2e2-4292-9a18-ae984b3be6a0</entry>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="uuid">27d4df7e-e2e2-4292-9a18-ae984b3be6a0</entry>
Aug 27 01:03:59 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:03:59 user nova-compute[73458]:     </system>
Aug 27 01:03:59 user nova-compute[73458]:   </sysinfo>
Aug 27 01:03:59 user nova-compute[73458]:   <os>
Aug 27 01:03:59 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:03:59 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:03:59 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:03:59 user nova-compute[73458]:   </os>
Aug 27 01:03:59 user nova-compute[73458]:   <features>
Aug 27 01:03:59 user nova-compute[73458]:     <acpi/>
Aug 27 01:03:59 user nova-compute[73458]:     <apic/>
Aug 27 01:03:59 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:03:59 user nova-compute[73458]:   </features>
Aug 27 01:03:59 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:03:59 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:03:59 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:03:59 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:03:59 user nova-compute[73458]:   </clock>
Aug 27 01:03:59 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:03:59 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:03:59 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:03:59 user nova-compute[73458]:   </cpu>
Aug 27 01:03:59 user nova-compute[73458]:   <devices>
Aug 27 01:03:59 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:03:59 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:03:59 user nova-compute[73458]:       <source dev="/dev/sde"/>
Aug 27 01:03:59 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:03:59 user nova-compute[73458]:       <serial>5c17661c-fd79-4eea-9d14-238851853550</serial>
Aug 27 01:03:59 user nova-compute[73458]:     </disk>
Aug 27 01:03:59 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:03:59 user nova-compute[73458]:       <mac address="fa:16:3e:5b:50:fc"/>
Aug 27 01:03:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:59 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:03:59 user nova-compute[73458]:       <target dev="tap0d59c227-d9"/>
Aug 27 01:03:59 user nova-compute[73458]:     </interface>
Aug 27 01:03:59 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:03:59 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0/console.log" append="off"/>
Aug 27 01:03:59 user nova-compute[73458]:     </serial>
Aug 27 01:03:59 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:03:59 user nova-compute[73458]:     <video>
Aug 27 01:03:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:03:59 user nova-compute[73458]:     </video>
Aug 27 01:03:59 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:03:59 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:03:59 user nova-compute[73458]:     </rng>
Aug 27 01:03:59 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:03:59 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:03:59 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:03:59 user nova-compute[73458]:     </memballoon>
Aug 27 01:03:59 user nova-compute[73458]:   </devices>
Aug 27 01:03:59 user nova-compute[73458]: </domain>
Aug 27 01:03:59 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG os_vif [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d59c227-d9, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d59c227-d9, col_values=(('external_ids', {'iface-id': '0d59c227-d91a-4bac-ad34-26bb8498cb56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:50:fc', 'vm-uuid': '27d4df7e-e2e2-4292-9a18-ae984b3be6a0'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:03:59 user nova-compute[73458]: INFO os_vif [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9')
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:03:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:5b:50:fc, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Successfully created port: b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] No waiting events found dispatching network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:00 user nova-compute[73458]: WARNING nova.compute.manager [req-855b7b67-61fd-40c6-a3ac-d6e126f726c0 req-75c5edf0-74c3-473f-99dc-8196c72a647e service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received unexpected event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 for instance with vm_state building and task_state spawning.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Successfully updated port: b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098241.1328695, aa2f396e-4858-4404-960a-66589a1fa275 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] VM Resumed (Lifecycle Event)
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Instance spawned successfully.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098241.1365788, aa2f396e-4858-4404-960a-66589a1fa275 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] VM Started (Lifecycle Event)
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing instance network info cache due to event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Took 7.37 seconds to spawn the instance on the hypervisor.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: INFO nova.compute.manager [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Took 8.61 seconds to build instance.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-311a91ad-ab0f-4a2c-b75f-1b44411d927a tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.745s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance network_info: |[{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start _get_guest_xml network_info=[{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:04:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-334211179',display_name='tempest-ServerRescueNegativeTestJSON-server-334211179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-334211179',id=31,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXCLPNRahrwnC+gKnfZ5AmrvDDoFntWf7hmadnHLR08PWgzTreG/rfjr60+7V6AI8ycGWsaXQ0AnQmcn38mLtrgREkWf0GOxm60960OmjMyLJ9FX7NLtj1q2nVtwO/ECw==',key_name='tempest-keypair-1932288392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-b51qnsl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=a8288776-acfb-4289-842e-d7c0139ee2ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:04:01 user nova-compute[73458]:   <uuid>a8288776-acfb-4289-842e-d7c0139ee2ae</uuid>
Aug 27 01:04:01 user nova-compute[73458]:   <name>instance-0000001f</name>
Aug 27 01:04:01 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:04:01 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:04:01 user nova-compute[73458]:   <metadata>
Aug 27 01:04:01 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:04:01 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-334211179</nova:name>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:04:01</nova:creationTime>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:04:01 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:04:01 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:owner>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 01:04:01 user nova-compute[73458]:       </nova:owner>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:04:01 user nova-compute[73458]:       <nova:ports>
Aug 27 01:04:01 user nova-compute[73458]:         <nova:port uuid="b1631295-d177-4f28-b28c-e9f333c0182e">
Aug 27 01:04:01 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 01:04:01 user nova-compute[73458]:         </nova:port>
Aug 27 01:04:01 user nova-compute[73458]:       </nova:ports>
Aug 27 01:04:01 user nova-compute[73458]:     </nova:instance>
Aug 27 01:04:01 user nova-compute[73458]:   </metadata>
Aug 27 01:04:01 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:04:01 user nova-compute[73458]:     <system>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="serial">a8288776-acfb-4289-842e-d7c0139ee2ae</entry>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="uuid">a8288776-acfb-4289-842e-d7c0139ee2ae</entry>
Aug 27 01:04:01 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:04:01 user nova-compute[73458]:     </system>
Aug 27 01:04:01 user nova-compute[73458]:   </sysinfo>
Aug 27 01:04:01 user nova-compute[73458]:   <os>
Aug 27 01:04:01 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:04:01 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:04:01 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:04:01 user nova-compute[73458]:   </os>
Aug 27 01:04:01 user nova-compute[73458]:   <features>
Aug 27 01:04:01 user nova-compute[73458]:     <acpi/>
Aug 27 01:04:01 user nova-compute[73458]:     <apic/>
Aug 27 01:04:01 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:04:01 user nova-compute[73458]:   </features>
Aug 27 01:04:01 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:04:01 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:04:01 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:04:01 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:04:01 user nova-compute[73458]:   </clock>
Aug 27 01:04:01 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:04:01 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:04:01 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:04:01 user nova-compute[73458]:   </cpu>
Aug 27 01:04:01 user nova-compute[73458]:   <devices>
Aug 27 01:04:01 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:04:01 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:04:01 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk"/>
Aug 27 01:04:01 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:04:01 user nova-compute[73458]:     </disk>
Aug 27 01:04:01 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:04:01 user nova-compute[73458]:       <mac address="fa:16:3e:b0:48:1b"/>
Aug 27 01:04:01 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:04:01 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:04:01 user nova-compute[73458]:       <target dev="tapb1631295-d1"/>
Aug 27 01:04:01 user nova-compute[73458]:     </interface>
Aug 27 01:04:01 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:04:01 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/console.log" append="off"/>
Aug 27 01:04:01 user nova-compute[73458]:     </serial>
Aug 27 01:04:01 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:04:01 user nova-compute[73458]:     <video>
Aug 27 01:04:01 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:04:01 user nova-compute[73458]:     </video>
Aug 27 01:04:01 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:04:01 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:04:01 user nova-compute[73458]:     </rng>
Aug 27 01:04:01 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:04:01 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:04:01 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:04:01 user nova-compute[73458]:     </memballoon>
Aug 27 01:04:01 user nova-compute[73458]:   </devices>
Aug 27 01:04:01 user nova-compute[73458]: </domain>
Aug 27 01:04:01 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-334211179',display_name='tempest-ServerRescueNegativeTestJSON-server-334211179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-334211179',id=31,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXCLPNRahrwnC+gKnfZ5AmrvDDoFntWf7hmadnHLR08PWgzTreG/rfjr60+7V6AI8ycGWsaXQ0AnQmcn38mLtrgREkWf0GOxm60960OmjMyLJ9FX7NLtj1q2nVtwO/ECw==',key_name='tempest-keypair-1932288392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-b51qnsl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=a8288776-acfb-4289-842e-d7c0139ee2ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG os_vif [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1631295-d1, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1631295-d1, col_values=(('external_ids', {'iface-id': 'b1631295-d177-4f28-b28c-e9f333c0182e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:48:1b', 'vm-uuid': 'a8288776-acfb-4289-842e-d7c0139ee2ae'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:01 user nova-compute[73458]: INFO os_vif [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1')
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:04:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:b0:48:1b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updated VIF entry in instance network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d84fce06-c9dc-4745-9039-5790db1c5178 req-ebf974b3-86c6-4e13-bcf3-5e819395a7de service nova] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:02 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:04:02 user nova-compute[73458]: INFO nova.compute.claims [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Claim successful on node user
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.610s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.policy [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c2d32f72d1b492a8547216dd6ab76ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19dbd4016f794fa180f1107d67f46e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:04:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Creating image(s)
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "/opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "/opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "/opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.265s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:03 user nova-compute[73458]: INFO nova.compute.manager [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Shelving
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098243.9675462, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Resumed (Lifecycle Event)
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:04:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance spawned successfully.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098243.968249, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Started (Lifecycle Event)
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:04 user nova-compute[73458]: WARNING nova.compute.manager [req-26f6efdc-b1e9-47b6-a1f0-0fe9b1171bdd req-d3fc5fd2-7c8a-4987-ac8e-bc400b18ea4e service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state building and task_state spawning.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.327s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Took 6.53 seconds to spawn the instance on the hypervisor.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk 1073741824" returned: 0 in 0.162s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.501s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.compute.manager [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Took 20.93 seconds to build instance.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.302s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:04 user nova-compute[73458]: WARNING nova.compute.manager [req-6915f45e-2906-48d1-8380-bdf7eeafa42e req-a4ed6215-2823-47b7-b98f-1af58513fd48 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state None.
Aug 27 01:04:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-708e66aa-bc7c-4915-9a64-e54244beb09c tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.217s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance destroyed successfully.
Aug 27 01:04:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Cannot resize image /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Beginning cold snapshot process
Aug 27 01:04:05 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk /opt/stack/data/nova/instances/snapshots/tmpakbmwnr4/5bb5b0df6371481d9b4f4346fd149245 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Successfully created port: 2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:06 user nova-compute[73458]: WARNING nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state building and task_state spawning.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:06 user nova-compute[73458]: WARNING nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:06 user nova-compute[73458]: WARNING nova.compute.manager [req-28457046-1edb-415c-8bd5-03b439c0f5e6 req-93f94800-b6bc-4be1-85d9-199b8d2f35f2 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk /opt/stack/data/nova/instances/snapshots/tmpakbmwnr4/5bb5b0df6371481d9b4f4346fd149245" returned: 0 in 1.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Snapshot extracted, beginning image upload
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098246.6162374, a8288776-acfb-4289-842e-d7c0139ee2ae => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Resumed (Lifecycle Event)
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance spawned successfully.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098246.6216533, a8288776-acfb-4289-842e-d7c0139ee2ae => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Started (Lifecycle Event)
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Took 8.63 seconds to spawn the instance on the hypervisor.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:06 user nova-compute[73458]: WARNING nova.compute.manager [req-53307b2f-bc5c-42ef-b9ae-02df1b8c6f79 req-87e709c7-6a7d-45b1-93ae-b204de27ea99 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state None.
Aug 27 01:04:06 user nova-compute[73458]: INFO nova.compute.manager [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Took 9.84 seconds to build instance.
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f987917-c800-4376-887c-dce5397e59ff tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.008s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Successfully updated port: 2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquired lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Releasing lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Instance network_info: |[{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Start _get_guest_xml network_info=[{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:04:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:07 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1209945458',display_name='tempest-TestStampPattern-server-1209945458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1209945458',id=32,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-q6i7xjfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:04:03Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=f714a2a9-c211-4881-9555-97ab44333f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'pci_devices' on Instance uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:04:07 user nova-compute[73458]:   <uuid>f714a2a9-c211-4881-9555-97ab44333f9c</uuid>
Aug 27 01:04:07 user nova-compute[73458]:   <name>instance-00000020</name>
Aug 27 01:04:07 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:04:07 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:04:07 user nova-compute[73458]:   <metadata>
Aug 27 01:04:07 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:04:07 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:name>tempest-TestStampPattern-server-1209945458</nova:name>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:04:07</nova:creationTime>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:04:07 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:04:07 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:owner>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:user uuid="9c2d32f72d1b492a8547216dd6ab76ab">tempest-TestStampPattern-650683177-project-member</nova:user>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:project uuid="19dbd4016f794fa180f1107d67f46e8a">tempest-TestStampPattern-650683177</nova:project>
Aug 27 01:04:07 user nova-compute[73458]:       </nova:owner>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:04:07 user nova-compute[73458]:       <nova:ports>
Aug 27 01:04:07 user nova-compute[73458]:         <nova:port uuid="2ea0718a-6084-420b-9e97-482bbde38ea0">
Aug 27 01:04:07 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 01:04:07 user nova-compute[73458]:         </nova:port>
Aug 27 01:04:07 user nova-compute[73458]:       </nova:ports>
Aug 27 01:04:07 user nova-compute[73458]:     </nova:instance>
Aug 27 01:04:07 user nova-compute[73458]:   </metadata>
Aug 27 01:04:07 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:04:07 user nova-compute[73458]:     <system>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="serial">f714a2a9-c211-4881-9555-97ab44333f9c</entry>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="uuid">f714a2a9-c211-4881-9555-97ab44333f9c</entry>
Aug 27 01:04:07 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:04:07 user nova-compute[73458]:     </system>
Aug 27 01:04:07 user nova-compute[73458]:   </sysinfo>
Aug 27 01:04:07 user nova-compute[73458]:   <os>
Aug 27 01:04:07 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:04:07 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:04:07 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:04:07 user nova-compute[73458]:   </os>
Aug 27 01:04:07 user nova-compute[73458]:   <features>
Aug 27 01:04:07 user nova-compute[73458]:     <acpi/>
Aug 27 01:04:07 user nova-compute[73458]:     <apic/>
Aug 27 01:04:07 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:04:07 user nova-compute[73458]:   </features>
Aug 27 01:04:07 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:04:07 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:04:07 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:04:07 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:04:07 user nova-compute[73458]:   </clock>
Aug 27 01:04:07 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:04:07 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:04:07 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:04:07 user nova-compute[73458]:   </cpu>
Aug 27 01:04:07 user nova-compute[73458]:   <devices>
Aug 27 01:04:07 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:04:07 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:04:07 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk"/>
Aug 27 01:04:07 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:04:07 user nova-compute[73458]:     </disk>
Aug 27 01:04:07 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:04:07 user nova-compute[73458]:       <mac address="fa:16:3e:01:76:b9"/>
Aug 27 01:04:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:04:07 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:04:07 user nova-compute[73458]:       <target dev="tap2ea0718a-60"/>
Aug 27 01:04:07 user nova-compute[73458]:     </interface>
Aug 27 01:04:07 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:04:07 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/console.log" append="off"/>
Aug 27 01:04:07 user nova-compute[73458]:     </serial>
Aug 27 01:04:07 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:04:07 user nova-compute[73458]:     <video>
Aug 27 01:04:07 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:04:07 user nova-compute[73458]:     </video>
Aug 27 01:04:07 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:04:07 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:04:07 user nova-compute[73458]:     </rng>
Aug 27 01:04:07 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:04:07 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:04:07 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:04:07 user nova-compute[73458]:     </memballoon>
Aug 27 01:04:07 user nova-compute[73458]:   </devices>
Aug 27 01:04:07 user nova-compute[73458]: </domain>
Aug 27 01:04:07 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1209945458',display_name='tempest-TestStampPattern-server-1209945458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1209945458',id=32,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-q6i7xjfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:04:03Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=f714a2a9-c211-4881-9555-97ab44333f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG os_vif [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea0718a-60, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ea0718a-60, col_values=(('external_ids', {'iface-id': '2ea0718a-6084-420b-9e97-482bbde38ea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:76:b9', 'vm-uuid': 'f714a2a9-c211-4881-9555-97ab44333f9c'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:07 user nova-compute[73458]: INFO os_vif [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60')
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:04:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No VIF found with MAC fa:16:3e:01:76:b9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing instance network info cache due to event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] Acquiring lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] Acquired lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:04:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updated VIF entry in instance network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6e44baab-e049-4931-8c73-3187af9c3a9c req-f486755d-4873-410b-a24b-8154f1c65e42 service nova] Releasing lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Snapshot image upload complete
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:09 user nova-compute[73458]: INFO nova.compute.manager [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] instance snapshotting
Aug 27 01:04:09 user nova-compute[73458]: INFO nova.compute.manager [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Shelve offloading
Aug 27 01:04:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Beginning live snapshot process
Aug 27 01:04:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance destroyed successfully.
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] No waiting events found dispatching network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:10 user nova-compute[73458]: WARNING nova.compute.manager [req-f51d4eae-8eb4-40b6-914c-72679941e7ac req-b04da0c9-0002-498b-b7f0-4be16271f0a7 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received unexpected event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 for instance with vm_state building and task_state spawning.
Aug 27 01:04:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json -f qcow2" returned: 0 in 0.317s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json -f qcow2" returned: 0 in 0.250s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7.delta 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:10 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7.delta 1073741824" returned: 0 in 0.054s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 01:04:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance destroyed successfully.
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'resources' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKybHO4sBlE9ZQP0/UdKOr+PWb5lDH3rEZXIDxVRoeNPc2IAB8zo3MRwYeFeKYrNNtFOuE7d/hyshrcCRhEFotMcShcBykIt49E1NvYewH87+/p7MY51p+w3ZDmZellbfg==',key_name='tempest-keypair-1675613778',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T01:04:09.793399',shelved_host='user',shelved_image_id='acf4d67b-2ea5-45a7-81de-ba26f30d86c6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG os_vif [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ab8536e-76, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:11 user nova-compute[73458]: INFO os_vif [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76')
Aug 27 01:04:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Deleting instance files /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33_del
Aug 27 01:04:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Deletion of /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33_del complete
Aug 27 01:04:11 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Deleted allocations for instance 8db27216-5890-41da-8297-c8f5c36b0d33
Aug 27 01:04:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'numa_topology' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.objects.base [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<8db27216-5890-41da-8297-c8f5c36b0d33> lazy-loaded attributes: resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:04:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098252.2801316, f714a2a9-c211-4881-9555-97ab44333f9c => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] VM Resumed (Lifecycle Event)
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Instance spawned successfully.
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098252.2941349, f714a2a9-c211-4881-9555-97ab44333f9c => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] VM Started (Lifecycle Event)
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 27459584 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Took 8.82 seconds to spawn the instance on the hypervisor.
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.643s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] No waiting events found dispatching network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:04:12 user nova-compute[73458]: WARNING nova.compute.manager [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received unexpected event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 for instance with vm_state building and task_state spawning.
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing instance network info cache due to event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.network.neutron [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e2fce88-dea8-42a9-a23d-0f1ed8ae2d8c tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.631s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.compute.manager [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Took 10.01 seconds to build instance.
Aug 27 01:04:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-095acddf-16a6-4946-9e0b-ad99befe9cf6 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.117s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 01:04:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 01:04:13 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:04:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7.delta /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:13 user nova-compute[73458]: DEBUG nova.network.neutron [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updated VIF entry in instance network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:04:13 user nova-compute[73458]: DEBUG nova.network.neutron [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5ab8536e-76", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:04:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bddf7881-27b1-471e-aa32-a2df5c57871e req-59d05a5f-1c39-4132-9551-d226f049d628 service nova] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:04:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7.delta /opt/stack/data/nova/instances/snapshots/tmpyt83vhsw/db650aa43b4143de906d01a9af9c31f7" returned: 0 in 0.516s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Snapshot extracted, beginning image upload
Aug 27 01:04:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:16 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Snapshot image upload complete
Aug 27 01:04:16 user nova-compute[73458]: INFO nova.compute.manager [None req-afb5389f-e996-4f67-9655-8365338e1ade tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Took 6.59 seconds to snapshot the instance on the hypervisor.
Aug 27 01:04:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:19 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098244.92932, 8db27216-5890-41da-8297-c8f5c36b0d33 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:04:19 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Stopped (Lifecycle Event)
Aug 27 01:04:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7df494ef-9006-4842-9eae-69eb3df8d65a None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:04:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:04:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:04:35 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:35 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7127MB free_disk=25.161849975585938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4571e0b0-c12a-407c-845e-67bc2a7480bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance aa2f396e-4858-4404-960a-66589a1fa275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:04:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:04:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:04:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:04:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 2317c1cf-8971-489e-928f-93a3a0ddf2b8 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 251d68d6-f239-4bcd-844a-cd0833a09d0e {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid aa2f396e-4858-4404-960a-66589a1fa275 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "c4b43432-4735-496d-a9e9-79a264633d35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "aa2f396e-4858-4404-960a-66589a1fa275" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "c4b43432-4735-496d-a9e9-79a264633d35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "aa2f396e-4858-4404-960a-66589a1fa275" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:04:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:04:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:05:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:14 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'info_cache' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance destroyed successfully.
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'resources' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2862faca-10, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:15 user nova-compute[73458]: INFO os_vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:15 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d831a97d-6d10-4c83-916d-42ec80a2fe37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b988a10-6b29-4c42-b890-1ad31cdb5a65]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786e7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6927b5-2dd1-4445-ad27-15972c90b585]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00bb42-ef0a-4e11-bc7f-4294ab2e6ac9]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b48e7c-58c0-4ddc-b233-42bd43ce0d9f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50baa0f-1a2a-476a-afaa-932795e412ed]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c99c585-6226-4933-8448-5c66662c6d64]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea4c3a9-0a2f-4c8e-a305-4dcd95116f1b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]
Aug 27 01:05:15 user nova-compute[73458]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d023654f-7a57-488e-a40d-711fc0f6c388]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== disconnect_volume: return (284ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start _get_guest_xml network_info=[{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '64b863a7-f34f-4188-be01-4a89b1248368', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf681136-6dc4-4202-978b-15e6b267aac1', 'serial': 'cf681136-6dc4-4202-978b-15e6b267aac1'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '05801e0e-e1d8-4d06-a086-14d736c16f7f', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'numa_topology' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:15 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:16 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:16 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:16 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be73fb8-2385-45da-a621-c0a097acde19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:05:16 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce921939-46fb-4d7c-ab34-1b5c052b069f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1] added
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[10446c25-b1ff-4f78-832d-036c2357d1b5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb0582-4bab-4024-aab4-9a16db9b1b5c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvtJsjWT {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cvtJsjWT" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdab4d5-efbf-4d93-b6c7-5c563e8da3f3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cvtJsjWT'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c5122-2186-4e60-b0be-35b8435e0e79]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9ebdc-f1fe-4eb8-b35b-8384814b9c6d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c90e3a-a899-4e60-906e-bb0a3391baf5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]
Aug 27 01:05:16 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[820c2605-97da-4424-91cc-0bea412a6b51]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab438d-9837-4be3-9896-51515129cf9d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:16 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1451b1-f4cd-4496-92f6-0fbc6b1b5eb3]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:05:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26462316364343733', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462316364343733', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:05:17 user nova-compute[73458]:   <uuid>64b863a7-f34f-4188-be01-4a89b1248368</uuid>
Aug 27 01:05:17 user nova-compute[73458]:   <name>instance-00000018</name>
Aug 27 01:05:17 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:05:17 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:05:17 user nova-compute[73458]:   <metadata>
Aug 27 01:05:17 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:05:17 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeTestJSON-server-827951787</nova:name>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:05:15</nova:creationTime>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:05:17 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:05:17 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:owner>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:user uuid="de7db48736b94edfa58071875ce52e65">tempest-AttachVolumeTestJSON-1240035283-project-member</nova:user>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:project uuid="621fecd1a05149b98beae4e5591b71e1">tempest-AttachVolumeTestJSON-1240035283</nova:project>
Aug 27 01:05:17 user nova-compute[73458]:       </nova:owner>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:05:17 user nova-compute[73458]:       <nova:ports>
Aug 27 01:05:17 user nova-compute[73458]:         <nova:port uuid="2862faca-1049-482c-9769-5980d4bbeef3">
Aug 27 01:05:17 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 01:05:17 user nova-compute[73458]:         </nova:port>
Aug 27 01:05:17 user nova-compute[73458]:       </nova:ports>
Aug 27 01:05:17 user nova-compute[73458]:     </nova:instance>
Aug 27 01:05:17 user nova-compute[73458]:   </metadata>
Aug 27 01:05:17 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:05:17 user nova-compute[73458]:     <system>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="serial">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="uuid">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:05:17 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:05:17 user nova-compute[73458]:     </system>
Aug 27 01:05:17 user nova-compute[73458]:   </sysinfo>
Aug 27 01:05:17 user nova-compute[73458]:   <os>
Aug 27 01:05:17 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:05:17 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:05:17 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:05:17 user nova-compute[73458]:   </os>
Aug 27 01:05:17 user nova-compute[73458]:   <features>
Aug 27 01:05:17 user nova-compute[73458]:     <acpi/>
Aug 27 01:05:17 user nova-compute[73458]:     <apic/>
Aug 27 01:05:17 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:05:17 user nova-compute[73458]:   </features>
Aug 27 01:05:17 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:05:17 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:05:17 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:05:17 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:05:17 user nova-compute[73458]:   </clock>
Aug 27 01:05:17 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:05:17 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:05:17 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:05:17 user nova-compute[73458]:   </cpu>
Aug 27 01:05:17 user nova-compute[73458]:   <devices>
Aug 27 01:05:17 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:05:17 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:05:17 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk"/>
Aug 27 01:05:17 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:05:17 user nova-compute[73458]:     </disk>
Aug 27 01:05:17 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:05:17 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:17 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:05:17 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 01:05:17 user nova-compute[73458]:       <serial>cf681136-6dc4-4202-978b-15e6b267aac1</serial>
Aug 27 01:05:17 user nova-compute[73458]:     </disk>
Aug 27 01:05:17 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:05:17 user nova-compute[73458]:       <mac address="fa:16:3e:29:54:c6"/>
Aug 27 01:05:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:17 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:05:17 user nova-compute[73458]:       <target dev="tap2862faca-10"/>
Aug 27 01:05:17 user nova-compute[73458]:     </interface>
Aug 27 01:05:17 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:05:17 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/console.log" append="off"/>
Aug 27 01:05:17 user nova-compute[73458]:     </serial>
Aug 27 01:05:17 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:05:17 user nova-compute[73458]:     <video>
Aug 27 01:05:17 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:17 user nova-compute[73458]:     </video>
Aug 27 01:05:17 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:05:17 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:05:17 user nova-compute[73458]:     </rng>
Aug 27 01:05:17 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:05:17 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:05:17 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:05:17 user nova-compute[73458]:     </memballoon>
Aug 27 01:05:17 user nova-compute[73458]:   </devices>
Aug 27 01:05:17 user nova-compute[73458]: </domain>
Aug 27 01:05:17 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Cannot resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'migration_context' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.objects.base [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG os_vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2862faca-10, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2862faca-10, col_values=(('external_ids', {'iface-id': '2862faca-1049-482c-9769-5980d4bbeef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:54:c6', 'vm-uuid': '64b863a7-f34f-4188-be01-4a89b1248368'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:18 user nova-compute[73458]: INFO os_vif [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:18 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:05:18 user nova-compute[73458]: INFO nova.compute.claims [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Claim successful on node user
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:05:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:05:19 user nova-compute[73458]: INFO nova.virt.block_device [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Booting with volume-backed-image 8d38b8b6-6075-47a6-bfce-08caf5b910c3 at /dev/vda
Aug 27 01:05:19 user nova-compute[73458]: DEBUG nova.policy [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a452f9412de4c8d881d30b02c01d3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3537b33489d84282958ddf05f58ade1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Successfully created port: 8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:20 user nova-compute[73458]: WARNING nova.compute.manager [req-1899ed0e-2092-4622-953c-8f4d380aaf46 req-8f3e9f1e-2625-4c73-9a46-9fe5f09ffd26 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state powering-on.
Aug 27 01:05:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Successfully updated port: 8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-changed-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG nova.compute.manager [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Refreshing instance network info cache due to event network-changed-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] Acquiring lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098322.29429, 64b863a7-f34f-4188-be01-4a89b1248368 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Resumed (Lifecycle Event)
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:05:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance rebooted successfully.
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ce1ceed8-1c1f-420f-9a2e-83ffbdcde2c4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098322.2991989, 64b863a7-f34f-4188-be01-4a89b1248368 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:22 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Started (Lifecycle Event)
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance network_info: |[{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] Acquired lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Refreshing network info cache for port 8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-changed-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Refreshing instance network info cache due to event network-changed-7505a9ae-0f36-4387-b971-1e34f396150e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Acquiring lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Acquired lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Refreshing network info cache for port 7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updated VIF entry in instance network info cache for port 8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-23c068d1-da70-478f-92e7-8fc591155a71 req-4e48082f-d4fb-42ee-ad90-6c0b6c5988e6 service nova] Releasing lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG nova.network.neutron [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updated VIF entry in instance network info cache for port 7505a9ae-0f36-4387-b971-1e34f396150e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG nova.network.neutron [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updating instance_info_cache with network_info: [{"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Releasing lock "refresh_cache-4571e0b0-c12a-407c-845e-67bc2a7480bb" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:23 user nova-compute[73458]: WARNING nova.compute.manager [req-357ffb1c-e4ed-4f57-a4c5-823f2d8ccd60 req-2d755cda-d13f-4218-bda8-7478ed11aeb1 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state active and task_state None.
Aug 27 01:05:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lazy-loading 'flavor' on Instance uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:26 user nova-compute[73458]: INFO nova.compute.manager [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Attaching volume f0b1bce9-21cd-430e-8994-2835b957ab51 to /dev/vdb
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.utils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2075635b-32ff-42cf-9e7c-845c426f296c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38017c3-0ba1-481b-91bf-5b8335ed3026]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[318285d0-628d-498a-a273-3dfbb8bae6c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b72a0-0d65-4252-959e-7c4006a3f57e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:26 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:05:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85fc668-8cf1-4867-8750-3ba70f26906f]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG os_brick.utils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:26 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updating existing volume attachment record: dfe2487f-e859-413a-8e0a-bf330e270fa2 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:05:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.utils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cdc672-91ce-4bb6-b065-d15a2d1ca8e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[16202e38-3189-477a-8b7b-4ff0cb8058bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[84649573-03d6-4a63-826e-f4b89ed62a46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473f6ef-b242-4f20-902d-4bed19ba9f98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:30 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:05:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[11434ebb-ec50-4c35-9ad5-a3554a5edba9]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG os_brick.utils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:30 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating existing volume attachment record: 7ed0e4ff-bfda-4f4b-8925-328ed85df36a {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing instance network info cache due to event network-changed-9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Refreshing network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG nova.network.neutron [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated VIF entry in instance network info cache for port 9414b9b8-e694-48da-9851-32597aba7fc2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG nova.network.neutron [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8d57ed80-4442-496b-8974-85a23fe21fc7 req-f0310d37-1ef4-4174-aba1-7188d1b41d48 service nova] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Stashing vm_state: active {{(pid=73458) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:05:36 user nova-compute[73458]: INFO nova.compute.claims [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Claim successful on node user
Aug 27 01:05:36 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating resource usage from migration 44beaa56-3684-41e0-90c2-94a4fbd80288
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-changed-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Refreshing instance network info cache due to event network-changed-0d59c227-d91a-4bac-ad34-26bb8498cb56. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.network.neutron [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Refreshing network info cache for port 0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:36 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:36 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:36 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7199MB free_disk=25.15658950805664GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:05:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.990s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:37 user nova-compute[73458]: INFO nova.compute.manager [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Migrating
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.453s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updated VIF entry in instance network info cache for port 0d59c227-d91a-4bac-ad34-26bb8498cb56. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b418dc91-23bb-4705-8dbd-619f0cda0bce req-b8b5efe4-7e4a-49d1-807c-95a885193fa1 service nova] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Applying migration context for instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 as it has an incoming, in-progress migration 44beaa56-3684-41e0-90c2-94a4fbd80288. Migration status is pre-migrating {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 01:05:37 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating resource usage from migration 44beaa56-3684-41e0-90c2-94a4fbd80288
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4571e0b0-c12a-407c-845e-67bc2a7480bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance aa2f396e-4858-4404-960a-66589a1fa275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Migration 44beaa56-3684-41e0-90c2-94a4fbd80288 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Starting migrate_disk_and_power_off {{(pid=73458) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:38 user nova-compute[73458]: WARNING nova.compute.manager [req-a6982cea-5965-4b5f-9105-606b2714902d req-4375769e-1e78-4991-aa19-351829efcddc service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state resize_migrating.
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance destroyed successfully.
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d59c227-d9, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:38 user nova-compute[73458]: INFO os_vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9')
Aug 27 01:05:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0ec3a-e397-464f-b744-03fecd0f9fce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[71514a77-856c-4ade-80ee-7acfa58f5869]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78540280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da7cd2d-cd41-45ec-a704-6239e3e298ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb8b7d-284d-4dd4-8b3b-9a34780b3a8e]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca13913-fd28-441f-a3af-8e58f92178c8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6afdc7-da0e-4b8a-a06f-1078477e1c1b]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8fe5c776',) {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[134943c2-3473-4f3c-a3d3-e2a0209b900d]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[57eca848-27db-495d-86dc-956b358bd072]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[586306b8-ee5a-4a56-a58a-daeaf76f2368]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]
Aug 27 01:05:39 user nova-compute[73458]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4687e26e-ab94-4692-8a11-cbad0496ba5e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== disconnect_volume: return (311ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jALaqhpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:39 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a5709a-01a6-4763-ac93-32f25e75f421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:05:39 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0239ea35-6028-4fe8-a4aa-7e4b73218021]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51] added
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb65184-cc52-46ec-943e-cedcc11db131]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca33913-b587-49f8-b3b3-a3c47452aaef]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jALaqhpZ {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jALaqhpZ" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3857a31-00f0-4275-983a-d8a3b3b0ca4a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jALaqhpZ'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9728441-21e1-459c-a01a-edfdc5d64580]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0522cd-f3e6-4267-b8e4-98363db26754]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa6855-aa17-4a43-9412-47b962b989f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260]
Aug 27 01:05:39 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6701e06-fee2-43a8-9018-b94024616c8b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e130cfe-ab81-41db-9ae1-f173da7493a5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b302ef-db35-4773-9275-742ac51cc944]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:05:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jALaqhpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Port 0d59c227-d91a-4bac-ad34-26bb8498cb56 binding to destination host user is already ACTIVE {{(pid=73458) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:40 user nova-compute[73458]: WARNING nova.compute.manager [req-1708b5d6-71d2-4782-a027-427e85d7164f req-a29716b7-d5e2-44e6-bc0b-c9c1927bdc42 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state resize_migrated.
Aug 27 01:05:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23765613264303538', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613264303538', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lazy-loading 'flavor' on Instance uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:05:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:40 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:05:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:05:40 user nova-compute[73458]:   <serial>f0b1bce9-21cd-430e-8994-2835b957ab51</serial>
Aug 27 01:05:40 user nova-compute[73458]: </disk>
Aug 27 01:05:40 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG os_brick.utils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0b2eff-72e8-4be7-9e16-d06fcaa8ec89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c7a16f-3cf8-42e6-a97e-fea45ebfd082]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79051d3-4aa2-4c69-907f-bd662c7d3184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fe6bc1-c19e-4dc0-a105-baecbfe549ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:41 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f13171-5868-45dd-921c-e3254bc1478e]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG os_brick.utils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] No VIF found with MAC fa:16:3e:55:a4:66, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:05:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4023d928-dc4c-4f83-933d-e2e9b935076a tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.464s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [{"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8fd76f35-50c9-4304-bad6-e72f01f03717" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:05:42 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Creating image(s)
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Ensure instance console log exists: /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start _get_guest_xml network_info=[{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fa53972-0393-4835-8139-e03fa0a64f42', 'attached_at': '', 'detached_at': '', 'volume_id': 'a71c1667-6e9a-4998-ad28-75548ca012c4', 'serial': 'a71c1667-6e9a-4998-ad28-75548ca012c4'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '7ed0e4ff-bfda-4f4b-8925-328ed85df36a', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:05:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:42 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:42 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:42 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b49ccb-9248-4158-963f-efb763fc729c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:05:42 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a074542-1875-499d-b449-4cd489722123]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4] added
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2155292f-80c4-423b-a9f7-5708a421976d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e47422-6400-4315-9bb9-8718f83f6e27]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLWycZQl {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLWycZQl" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369b5c6-c526-4bb4-b383-af65bbf4be86]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oLWycZQl'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[57021e4e-e3ed-42e1-a57f-dab22d634973]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: INFO nova.compute.manager [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Detaching volume f0b1bce9-21cd-430e-8994-2835b957ab51
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4b23a7-8a2f-4df8-bde2-0ccf9dcb74ed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: INFO nova.virt.block_device [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Attempting to driver detach volume f0b1bce9-21cd-430e-8994-2835b957ab51 from mountpoint /dev/vdb
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b3cc3e-8b51-4bf4-adf5-20a43acf341d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260]
Aug 27 01:05:43 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Attempting to detach device vdb from instance 4571e0b0-c12a-407c-845e-67bc2a7480bb from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:05:43 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:43 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:05:43 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:05:43 user nova-compute[73458]:   <serial>f0b1bce9-21cd-430e-8994-2835b957ab51</serial>
Aug 27 01:05:43 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:05:43 user nova-compute[73458]: </disk>
Aug 27 01:05:43 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:05:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Successfully detached device vdb from instance 4571e0b0-c12a-407c-845e-67bc2a7480bb from the persistent domain config.
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4571e0b0-c12a-407c-845e-67bc2a7480bb from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:05:43 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:43 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:05:43 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:05:43 user nova-compute[73458]:   <serial>f0b1bce9-21cd-430e-8994-2835b957ab51</serial>
Aug 27 01:05:43 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:05:43 user nova-compute[73458]: </disk>
Aug 27 01:05:43 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.108s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109680f-8d60-4ac9-990a-47745b4e3a72]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff97d56-d47e-4855-9e76-96e3bf0e3b44]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3819e1-146c-4892-898f-e64e90ed1883]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098343.875867, 4571e0b0-c12a-407c-845e-67bc2a7480bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:05:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Successfully detached device vdb from instance 4571e0b0-c12a-407c-845e-67bc2a7480bb from the live domain config.
Aug 27 01:05:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jALaqhpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:43 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '23436323166353330', 'path': '/dev/sdf'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436323166353330', 'path': '/dev/sdf'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.537s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e292017-c4a3-4d70-be6f-580f77096f98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908692436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908692436',id=33,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-nx2zr64e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:20Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=8fa53972-0393-4835-8139-e03fa0a64f42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:05:44 user nova-compute[73458]:   <uuid>8fa53972-0393-4835-8139-e03fa0a64f42</uuid>
Aug 27 01:05:44 user nova-compute[73458]:   <name>instance-00000021</name>
Aug 27 01:05:44 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:05:44 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:05:44 user nova-compute[73458]:   <metadata>
Aug 27 01:05:44 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:05:44 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1908692436</nova:name>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:05:42</nova:creationTime>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:05:44 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:05:44 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:owner>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 01:05:44 user nova-compute[73458]:       </nova:owner>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:05:44 user nova-compute[73458]:       <nova:ports>
Aug 27 01:05:44 user nova-compute[73458]:         <nova:port uuid="8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81">
Aug 27 01:05:44 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 01:05:44 user nova-compute[73458]:         </nova:port>
Aug 27 01:05:44 user nova-compute[73458]:       </nova:ports>
Aug 27 01:05:44 user nova-compute[73458]:     </nova:instance>
Aug 27 01:05:44 user nova-compute[73458]:   </metadata>
Aug 27 01:05:44 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:05:44 user nova-compute[73458]:     <system>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="serial">8fa53972-0393-4835-8139-e03fa0a64f42</entry>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="uuid">8fa53972-0393-4835-8139-e03fa0a64f42</entry>
Aug 27 01:05:44 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:05:44 user nova-compute[73458]:     </system>
Aug 27 01:05:44 user nova-compute[73458]:   </sysinfo>
Aug 27 01:05:44 user nova-compute[73458]:   <os>
Aug 27 01:05:44 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:05:44 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:05:44 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:05:44 user nova-compute[73458]:   </os>
Aug 27 01:05:44 user nova-compute[73458]:   <features>
Aug 27 01:05:44 user nova-compute[73458]:     <acpi/>
Aug 27 01:05:44 user nova-compute[73458]:     <apic/>
Aug 27 01:05:44 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:05:44 user nova-compute[73458]:   </features>
Aug 27 01:05:44 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:05:44 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:05:44 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:05:44 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:05:44 user nova-compute[73458]:   </clock>
Aug 27 01:05:44 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:05:44 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:05:44 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:05:44 user nova-compute[73458]:   </cpu>
Aug 27 01:05:44 user nova-compute[73458]:   <devices>
Aug 27 01:05:44 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:05:44 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:44 user nova-compute[73458]:       <source dev="/dev/sdf"/>
Aug 27 01:05:44 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:05:44 user nova-compute[73458]:       <serial>a71c1667-6e9a-4998-ad28-75548ca012c4</serial>
Aug 27 01:05:44 user nova-compute[73458]:     </disk>
Aug 27 01:05:44 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:05:44 user nova-compute[73458]:       <mac address="fa:16:3e:f1:40:15"/>
Aug 27 01:05:44 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:44 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:05:44 user nova-compute[73458]:       <target dev="tap8e4330f6-6a"/>
Aug 27 01:05:44 user nova-compute[73458]:     </interface>
Aug 27 01:05:44 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:05:44 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/console.log" append="off"/>
Aug 27 01:05:44 user nova-compute[73458]:     </serial>
Aug 27 01:05:44 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:05:44 user nova-compute[73458]:     <video>
Aug 27 01:05:44 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:44 user nova-compute[73458]:     </video>
Aug 27 01:05:44 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:05:44 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:05:44 user nova-compute[73458]:     </rng>
Aug 27 01:05:44 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:05:44 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:05:44 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:05:44 user nova-compute[73458]:     </memballoon>
Aug 27 01:05:44 user nova-compute[73458]:   </devices>
Aug 27 01:05:44 user nova-compute[73458]: </domain>
Aug 27 01:05:44 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908692436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908692436',id=33,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-nx2zr64e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:20Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=8fa53972-0393-4835-8139-e03fa0a64f42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_vif [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e4330f6-6a, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e4330f6-6a, col_values=(('external_ids', {'iface-id': '8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:40:15', 'vm-uuid': '8fa53972-0393-4835-8139-e03fa0a64f42'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70fae29-72b8-4e90-ae67-8d5c156af022]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9038c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:44 user nova-compute[73458]: INFO os_vif [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a')
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b7c283-81a5-406f-92f3-14a538514e9b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef61f8b-5c3d-46cf-afd3-3d2e1ed5b4df]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:f1:40:15, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[76218d8f-4b2e-4a45-82ae-cb69c373d7cc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43304c-5cca-4ed7-897e-2968cec57f39]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[370af751-237a-451e-8043-79d63282ec05]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4f5df-af11-4cd8-8c1f-bb1f249afe3f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260]
Aug 27 01:05:44 user nova-compute[73458]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b1bce9-21cd-430e-8994-2835b957ab51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93efc4fe-eb32-405c-be76-6c4743760b20]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] <== disconnect_volume: return (887ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-changed-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Refreshing instance network info cache due to event network-changed-9e320894-5cc8-4ef4-b2bf-e665a22d5168. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] Acquiring lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] Acquired lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:44 user nova-compute[73458]: DEBUG nova.network.neutron [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Refreshing network info cache for port 9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:45 user nova-compute[73458]: INFO nova.compute.manager [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Terminating instance
Aug 27 01:05:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updated VIF entry in instance network info cache for port 9e320894-5cc8-4ef4-b2bf-e665a22d5168. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updating instance_info_cache with network_info: [{"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-82b194c8-ccc2-428e-8150-d2542588c715 req-4f8fe321-fc9b-45a1-a9ca-c7b12240dd7d service nova] Releasing lock "refresh_cache-aa2f396e-4858-4404-960a-66589a1fa275" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lazy-loading 'flavor' on Instance uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04c51294-e0ce-4f43-b70b-1092602b13bb tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.690s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Instance destroyed successfully.
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'resources' on Instance uuid aa2f396e-4858-4404-960a-66589a1fa275 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1320784007',display_name='tempest-AttachVolumeNegativeTest-server-1320784007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1320784007',id=30,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAe1JVxp34H+TMDu7VqLkNGBd9/dx9E0VF2SA9F5b5rZWVXH4j/pwOXvSdy2BkABEs7v1Qb8PZGnRMLpJJMImPwKrWtQpF+plgmeBKxWj86UaxzCCfE5WRgh2mANfapSxw==',key_name='tempest-keypair-1548115037',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-bn9qoy80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=aa2f396e-4858-4404-960a-66589a1fa275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "address": "fa:16:3e:7e:79:cc", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e320894-5c", "ovs_interfaceid": "9e320894-5cc8-4ef4-b2bf-e665a22d5168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG os_vif [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e320894-5c, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: INFO os_vif [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:79:cc,bridge_name='br-int',has_traffic_filtering=True,id=9e320894-5cc8-4ef4-b2bf-e665a22d5168,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e320894-5c')
Aug 27 01:05:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Deleting instance files /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275_del
Aug 27 01:05:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Deletion of /opt/stack/data/nova/instances/aa2f396e-4858-4404-960a-66589a1fa275_del complete
Aug 27 01:05:46 user nova-compute[73458]: INFO nova.compute.manager [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:46 user nova-compute[73458]: WARNING nova.compute.manager [req-34f3d57b-80a3-49ea-a049-71df24d9d82c req-45b13b0a-2478-4c9e-8b23-1b0582acff44 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state building and task_state spawning.
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-unplugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] No waiting events found dispatching network-vif-unplugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-unplugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Acquiring lock "aa2f396e-4858-4404-960a-66589a1fa275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] Lock "aa2f396e-4858-4404-960a-66589a1fa275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] No waiting events found dispatching network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:46 user nova-compute[73458]: WARNING nova.compute.manager [req-2fbfc08f-bae7-4d38-a352-f05dd9bc4d35 req-a5ac59b1-d0d5-4023-a560-6fa2a310c2d1 service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received unexpected event network-vif-plugged-9e320894-5cc8-4ef4-b2bf-e665a22d5168 for instance with vm_state active and task_state deleting.
Aug 27 01:05:47 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:47 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Took 1.32 seconds to deallocate network for instance.
Aug 27 01:05:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing instance network info cache due to event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Deleted allocations for instance aa2f396e-4858-4404-960a-66589a1fa275
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c3736878-99e2-46a1-bf34-f302a5f27eee tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "aa2f396e-4858-4404-960a-66589a1fa275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.205s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098348.4354496, 8fa53972-0393-4835-8139-e03fa0a64f42 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Resumed (Lifecycle Event)
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'flavor' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance spawned successfully.
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098348.4386854, 8fa53972-0393-4835-8139-e03fa0a64f42 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Started (Lifecycle Event)
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Took 29.68 seconds to build instance.
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dd6afa4e-a7b7-4bbd-82fc-b8bdbe0b7de6 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.035s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:48 user nova-compute[73458]: INFO nova.compute.manager [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Attaching volume 5d4c51c9-1f63-4225-be53-53cb3ba9b88d to /dev/vdb
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updated VIF entry in instance network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-84053974-deb9-45b2-9613-9fffa3d4b070 req-23277012-fbdc-4b24-8f06-b572845f3a2f service nova] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.utils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:48 user nova-compute[73458]: WARNING nova.compute.manager [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state None.
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-a8803165-1b25-46bb-beb9-8b58bd0b0f92 req-f9cb243a-5ccd-4ebc-8bb8-e7c98b34090f service nova] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Received event network-vif-deleted-9e320894-5cc8-4ef4-b2bf-e665a22d5168 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d286ea7-b7be-4a48-b3c9-2fcb47cc3f23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ec884-09d4-4012-a124-57f9ffd93666]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef65d93-04b9-4d23-b700-98268238eab2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07001066-3a75-4e84-acf2-39850241df91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:48 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:05:48 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0a9b1-6202-4c9b-ae44-58eddf1a8c61]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG os_brick.utils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:48 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating existing volume attachment record: 77e80809-0639-40be-930a-c8043fc1ec8c {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:05:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Starting finish_migration {{(pid=73458) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 01:05:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Creating image(s)
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start _get_guest_xml network_info=[{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '27d4df7e-e2e2-4292-9a18-ae984b3be6a0', 'attached_at': '2023-08-27T01:05:53.000000', 'detached_at': '', 'volume_id': '5c17661c-fd79-4eea-9d14-238851853550', 'serial': '5c17661c-fd79-4eea-9d14-238851853550'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '0e0d66d4-8d49-4a15-8841-ee49bf4897aa', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:05:53 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:53 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:53 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:53 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:05:53 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70b56a-8293-4fdf-9630-f4b72cb19d07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:05:53 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50655482-64e5-436f-a325-082ccb4a370d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550] added
Aug 27 01:05:53 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098338.8617241, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:53 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Stopped (Lifecycle Event)
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a985902d-7704-433e-b768-d8d31ce2b1d4 None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e31491-92ad-4967-905b-02da401f79c7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a985902d-7704-433e-b768-d8d31ce2b1d4 None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e5f92-faaf-4379-ad11-1ef8852cf73d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: INFO nova.compute.manager [None req-a985902d-7704-433e-b768-d8d31ce2b1d4 None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfOaEUBm {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TfOaEUBm" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd71c432-7764-4b7b-a386-1ccb62f9fccf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TfOaEUBm'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7b12a-a903-41ef-bb06-4d8d5a315971]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5554e3d-8548-47bd-b0b9-b7af0bd26662]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8aea87-0765-45f8-a77b-e50295490b95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]
Aug 27 01:05:54 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.
Aug 27 01:05:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274c67b-0cfa-45d1-8eac-af1ea898391f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d728cca-1a02-4343-8010-1726a4c22652]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:05:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[056772e8-807a-4373-ada1-4df0ace2f60a]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing instance network info cache due to event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] Acquiring lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] Acquired lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:54 user nova-compute[73458]: DEBUG nova.network.neutron [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.neutron [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updated VIF entry in instance network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.neutron [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e0805fa-97cd-40d0-80c2-9349431630e6 req-a8fb7920-8a87-459e-bee6-bcb121bd5804 service nova] Releasing lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23435323435373230', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435323435373230', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:55 user nova-compute[73458]: INFO nova.compute.manager [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Attaching volume 78b55ec3-b841-4fc3-ad50-407547919f1b to /dev/vdb
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:05:55 user nova-compute[73458]:   <uuid>27d4df7e-e2e2-4292-9a18-ae984b3be6a0</uuid>
Aug 27 01:05:55 user nova-compute[73458]:   <name>instance-0000001d</name>
Aug 27 01:05:55 user nova-compute[73458]:   <memory>2097152</memory>
Aug 27 01:05:55 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:05:55 user nova-compute[73458]:   <metadata>
Aug 27 01:05:55 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:05:55 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:05:55 user nova-compute[73458]:       <nova:name>tempest-ServerActionsTestOtherA-server-414505967</nova:name>
Aug 27 01:05:55 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:05:53</nova:creationTime>
Aug 27 01:05:55 user nova-compute[73458]:       <nova:flavor name="m1.small">
Aug 27 01:05:55 user nova-compute[73458]:         <nova:memory>2048</nova:memory>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:disk>20</nova:disk>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:05:55 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:05:55 user nova-compute[73458]:       <nova:owner>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:user uuid="15e8844b6f594cef9e904b88a6ca42b9">tempest-ServerActionsTestOtherA-1449025138-project-member</nova:user>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:project uuid="bd605e8ac6e749718ba402ae385a24bd">tempest-ServerActionsTestOtherA-1449025138</nova:project>
Aug 27 01:05:55 user nova-compute[73458]:       </nova:owner>
Aug 27 01:05:55 user nova-compute[73458]:       <nova:ports>
Aug 27 01:05:55 user nova-compute[73458]:         <nova:port uuid="0d59c227-d91a-4bac-ad34-26bb8498cb56">
Aug 27 01:05:55 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:05:55 user nova-compute[73458]:         </nova:port>
Aug 27 01:05:55 user nova-compute[73458]:       </nova:ports>
Aug 27 01:05:55 user nova-compute[73458]:     </nova:instance>
Aug 27 01:05:55 user nova-compute[73458]:   </metadata>
Aug 27 01:05:55 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:05:55 user nova-compute[73458]:     <system>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="serial">27d4df7e-e2e2-4292-9a18-ae984b3be6a0</entry>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="uuid">27d4df7e-e2e2-4292-9a18-ae984b3be6a0</entry>
Aug 27 01:05:55 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:05:55 user nova-compute[73458]:     </system>
Aug 27 01:05:55 user nova-compute[73458]:   </sysinfo>
Aug 27 01:05:55 user nova-compute[73458]:   <os>
Aug 27 01:05:55 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:05:55 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:05:55 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:05:55 user nova-compute[73458]:   </os>
Aug 27 01:05:55 user nova-compute[73458]:   <features>
Aug 27 01:05:55 user nova-compute[73458]:     <acpi/>
Aug 27 01:05:55 user nova-compute[73458]:     <apic/>
Aug 27 01:05:55 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:05:55 user nova-compute[73458]:   </features>
Aug 27 01:05:55 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:05:55 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:05:55 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:05:55 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:05:55 user nova-compute[73458]:   </clock>
Aug 27 01:05:55 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:05:55 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:05:55 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:05:55 user nova-compute[73458]:   </cpu>
Aug 27 01:05:55 user nova-compute[73458]:   <devices>
Aug 27 01:05:55 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:05:55 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:05:55 user nova-compute[73458]:       <source dev="/dev/sde"/>
Aug 27 01:05:55 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:05:55 user nova-compute[73458]:       <serial>5c17661c-fd79-4eea-9d14-238851853550</serial>
Aug 27 01:05:55 user nova-compute[73458]:     </disk>
Aug 27 01:05:55 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:05:55 user nova-compute[73458]:       <mac address="fa:16:3e:5b:50:fc"/>
Aug 27 01:05:55 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:55 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:05:55 user nova-compute[73458]:       <target dev="tap0d59c227-d9"/>
Aug 27 01:05:55 user nova-compute[73458]:     </interface>
Aug 27 01:05:55 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:05:55 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0/console.log" append="off"/>
Aug 27 01:05:55 user nova-compute[73458]:     </serial>
Aug 27 01:05:55 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:05:55 user nova-compute[73458]:     <video>
Aug 27 01:05:55 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:05:55 user nova-compute[73458]:     </video>
Aug 27 01:05:55 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:05:55 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:05:55 user nova-compute[73458]:     </rng>
Aug 27 01:05:55 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:05:55 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:05:55 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:05:55 user nova-compute[73458]:     </memballoon>
Aug 27 01:05:55 user nova-compute[73458]:   </devices>
Aug 27 01:05:55 user nova-compute[73458]: </domain>
Aug 27 01:05:55 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1840300088-network", "vif_mac": "fa:16:3e:5b:50:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d59c227-d9, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d59c227-d9, col_values=(('external_ids', {'iface-id': '0d59c227-d91a-4bac-ad34-26bb8498cb56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:50:fc', 'vm-uuid': '27d4df7e-e2e2-4292-9a18-ae984b3be6a0'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:55 user nova-compute[73458]: INFO os_vif [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9')
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.utils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[117dd49d-05a9-4179-9190-f30cc6acae28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] No VIF found with MAC fa:16:3e:5b:50:fc, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec660c-2994-4b38-b177-dec86c40b48d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b82c9-76bf-4654-8046-6d2fb5534fce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a144d-5e2f-4e3a-a08a-efe22d71bc62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:05:55 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:05:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e4afa-f218-4cc0-b7ae-839891d28e71]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG os_brick.utils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:05:55 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating existing volume attachment record: 8aa48b4b-d469-41d2-a07e-9cb525a4d9ed {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:05:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:57 user nova-compute[73458]: WARNING nova.compute.manager [req-f33eda3e-a4ab-4c69-ba0c-9f5347473732 req-604b5647-82b8-4190-bab6-00fded0b4c43 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state resize_finish.
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:57 user nova-compute[73458]: INFO nova.compute.manager [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Unshelving
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_requests' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'numa_topology' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:58 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:05:58 user nova-compute[73458]: INFO nova.compute.claims [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Claim successful on node user
Aug 27 01:05:58 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:05:58 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:05:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:58 user nova-compute[73458]: INFO nova.network.neutron [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating port 5ab8536e-76a7-47f7-9671-fbde015141eb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 01:05:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098359.0437458, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Resumed (Lifecycle Event)
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance running successfully.
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Failed to set time: agent not configured {{(pid=73458) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-061426e1-5eda-470f-b0ce-496bd2ac9a68 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] finish_migration finished successfully. {{(pid=73458) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098359.0439308, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Started (Lifecycle Event)
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:05:59 user nova-compute[73458]: WARNING nova.compute.manager [req-f48108b6-c042-46ba-b921-8fc8bd66a306 req-90e98abd-2be0-4e3b-a1e3-aa7e7da8e4df service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state resize_finish.
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:05:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Creating image(s)
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG nova.objects.base [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<8db27216-5890-41da-8297-c8f5c36b0d33> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "3cb4732bb60ad7614cb56a6810201b4af599332a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:05:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "3cb4732bb60ad7614cb56a6810201b4af599332a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing instance network info cache due to event network-changed-5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] Acquiring lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] Acquired lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Refreshing network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.part --force-share --output=json" returned: 0 in 0.229s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.virt.images [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] acf4d67b-2ea5-45a7-81de-ba26f30d86c6 was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.part /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098346.2953866, aa2f396e-4858-4404-960a-66589a1fa275 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:01 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: aa2f396e-4858-4404-960a-66589a1fa275] VM Stopped (Lifecycle Event)
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-bd7deb71-f37f-4c4b-ac97-ee2dce40c615 None None] [instance: aa2f396e-4858-4404-960a-66589a1fa275] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.part /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.converted" returned: 0 in 0.583s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzFTohyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:06:01 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:01 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:01 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[70804427-199a-4c16-bd8b-148cc43daff8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:06:02 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4651ea-dfbf-4988-a0e2-a5e114d55041]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d] added
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba01ade5-ab49-4a53-9a63-2abd0f65daee]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e702b-206a-4551-b0a0-5caac5ff1e36]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzFTohyn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wzFTohyn" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1aceb-d9a1-4a89-8131-1b3f49dda88e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wzFTohyn'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "3cb4732bb60ad7614cb56a6810201b4af599332a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.155s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0cac2c-922e-4062-b873-ccdd8edebfde]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bde9d-25dd-4f67-8543-5ffc2193c9c0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updated VIF entry in instance network info cache for port 5ab8536e-76a7-47f7-9671-fbde015141eb. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a89eb-d5b5-4504-a444-3805d13e5a88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260]
Aug 27 01:06:02 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260] successful.
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f085ed95-7c71-45dd-97a7-5b41827c5309 req-7a5d6589-017a-4c8f-9ff5-624b6dc6c286 service nova] Releasing lock "refresh_cache-8db27216-5890-41da-8297-c8f5c36b0d33" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c64b0-0edd-49ea-b362-d50326d3d0f1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json" returned: 0 in 0.211s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "3cb4732bb60ad7614cb56a6810201b4af599332a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "3cb4732bb60ad7614cb56a6810201b4af599332a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854203a-f039-4fbc-a2a0-1589ef9dd6c8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:02 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:02 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fbbd9-d8f6-4033-b7bd-13a254405b16]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a,backing_fmt=raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a,backing_fmt=raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk 1073741824" returned: 0 in 0.051s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "3cb4732bb60ad7614cb56a6810201b4af599332a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a --force-share --output=json" returned: 0 in 0.251s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'migration_context' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:02 user nova-compute[73458]: DEBUG nova.objects.base [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<8db27216-5890-41da-8297-c8f5c36b0d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Rebasing disk image.
Aug 27 01:06:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 -F raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzFTohyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23730346533333936', 'path': '/dev/sdg'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730346533333936', 'path': '/dev/sdg'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.objects.instance [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'flavor' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:06:03 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:03 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 01:06:03 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:03 user nova-compute[73458]:   <serial>5d4c51c9-1f63-4225-be53-53cb3ba9b88d</serial>
Aug 27 01:06:03 user nova-compute[73458]: </disk>
Aug 27 01:06:03 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:b0:48:1b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:06:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-124024b4-6cee-407f-8319-a45c4622bd2d tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.405s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:05 user nova-compute[73458]: INFO nova.compute.manager [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Rescuing
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 -F raw /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk" returned: 0 in 2.863s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Ensure instance console log exists: /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start _get_guest_xml network_info=[{"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2957f33be3d8b970ab48420b9c4aa5ab',container_format='bare',created_at=2023-08-27T01:04:04Z,direct_url=<?>,disk_format='qcow2',id=acf4d67b-2ea5-45a7-81de-ba26f30d86c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1350033724-shelved',owner='d726b2aaef554069ace63df4c4e92717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T01:04:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:06:05 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:05 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2957f33be3d8b970ab48420b9c4aa5ab',container_format='bare',created_at=2023-08-27T01:04:04Z,direct_url=<?>,disk_format='qcow2',id=acf4d67b-2ea5-45a7-81de-ba26f30d86c6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1350033724-shelved',owner='d726b2aaef554069ace63df4c4e92717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T01:04:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:05 user nova-compute[73458]: DEBUG nova.objects.base [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<8db27216-5890-41da-8297-c8f5c36b0d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='acf4d67b-2ea5-45a7-81de-ba26f30d86c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1675613778',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T01:04:09.793399',shelved_host='user',shelved_image_id='acf4d67b-2ea5-45a7-81de-ba26f30d86c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'pci_devices' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.objects.base [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Object Instance<8db27216-5890-41da-8297-c8f5c36b0d33> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:06:06 user nova-compute[73458]:   <uuid>8db27216-5890-41da-8297-c8f5c36b0d33</uuid>
Aug 27 01:06:06 user nova-compute[73458]:   <name>instance-0000001a</name>
Aug 27 01:06:06 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:06:06 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:06:06 user nova-compute[73458]:   <metadata>
Aug 27 01:06:06 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:06:06 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1350033724</nova:name>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:06:05</nova:creationTime>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:06:06 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:06:06 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:owner>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:user uuid="017197a0401c456f97c4260b62669916">tempest-AttachVolumeShelveTestJSON-462549752-project-member</nova:user>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:project uuid="d726b2aaef554069ace63df4c4e92717">tempest-AttachVolumeShelveTestJSON-462549752</nova:project>
Aug 27 01:06:06 user nova-compute[73458]:       </nova:owner>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:root type="image" uuid="acf4d67b-2ea5-45a7-81de-ba26f30d86c6"/>
Aug 27 01:06:06 user nova-compute[73458]:       <nova:ports>
Aug 27 01:06:06 user nova-compute[73458]:         <nova:port uuid="5ab8536e-76a7-47f7-9671-fbde015141eb">
Aug 27 01:06:06 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 01:06:06 user nova-compute[73458]:         </nova:port>
Aug 27 01:06:06 user nova-compute[73458]:       </nova:ports>
Aug 27 01:06:06 user nova-compute[73458]:     </nova:instance>
Aug 27 01:06:06 user nova-compute[73458]:   </metadata>
Aug 27 01:06:06 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:06:06 user nova-compute[73458]:     <system>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="serial">8db27216-5890-41da-8297-c8f5c36b0d33</entry>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="uuid">8db27216-5890-41da-8297-c8f5c36b0d33</entry>
Aug 27 01:06:06 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:06:06 user nova-compute[73458]:     </system>
Aug 27 01:06:06 user nova-compute[73458]:   </sysinfo>
Aug 27 01:06:06 user nova-compute[73458]:   <os>
Aug 27 01:06:06 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:06:06 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:06:06 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:06:06 user nova-compute[73458]:   </os>
Aug 27 01:06:06 user nova-compute[73458]:   <features>
Aug 27 01:06:06 user nova-compute[73458]:     <acpi/>
Aug 27 01:06:06 user nova-compute[73458]:     <apic/>
Aug 27 01:06:06 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:06:06 user nova-compute[73458]:   </features>
Aug 27 01:06:06 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:06:06 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:06:06 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:06:06 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:06:06 user nova-compute[73458]:   </clock>
Aug 27 01:06:06 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:06:06 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:06:06 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:06:06 user nova-compute[73458]:   </cpu>
Aug 27 01:06:06 user nova-compute[73458]:   <devices>
Aug 27 01:06:06 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:06:06 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:06:06 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk"/>
Aug 27 01:06:06 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:06:06 user nova-compute[73458]:     </disk>
Aug 27 01:06:06 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:06:06 user nova-compute[73458]:       <mac address="fa:16:3e:7b:b5:72"/>
Aug 27 01:06:06 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:06:06 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:06:06 user nova-compute[73458]:       <target dev="tap5ab8536e-76"/>
Aug 27 01:06:06 user nova-compute[73458]:     </interface>
Aug 27 01:06:06 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:06:06 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/console.log" append="off"/>
Aug 27 01:06:06 user nova-compute[73458]:     </serial>
Aug 27 01:06:06 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:06:06 user nova-compute[73458]:     <video>
Aug 27 01:06:06 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:06:06 user nova-compute[73458]:     </video>
Aug 27 01:06:06 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:06:06 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:06:06 user nova-compute[73458]:     </rng>
Aug 27 01:06:06 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:06:06 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:06:06 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:06:06 user nova-compute[73458]:     </memballoon>
Aug 27 01:06:06 user nova-compute[73458]:   </devices>
Aug 27 01:06:06 user nova-compute[73458]: </domain>
Aug 27 01:06:06 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='acf4d67b-2ea5-45a7-81de-ba26f30d86c6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1675613778',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member',shelved_at='2023-08-27T01:04:09.793399',shelved_host='user',shelved_image_id='acf4d67b-2ea5-45a7-81de-ba26f30d86c6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG os_vif [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ab8536e-76, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ab8536e-76, col_values=(('external_ids', {'iface-id': '5ab8536e-76a7-47f7-9671-fbde015141eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b5:72', 'vm-uuid': '8db27216-5890-41da-8297-c8f5c36b0d33'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: INFO os_vif [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76')
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] No VIF found with MAC fa:16:3e:7b:b5:72, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:06 user nova-compute[73458]: WARNING nova.compute.manager [req-791c9725-4321-43c7-9367-c89912e4c0ab req-9dd20c46-167f-447f-96e5-a63ae1e7f485 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state active and task_state rescuing.
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance destroyed successfully.
Aug 27 01:06:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Attempting rescue
Aug 27 01:06:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 01:06:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Creating image(s)
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue" returned: 0 in 0.054s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'migration_context' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.base [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<a8288776-acfb-4289-842e-d7c0139ee2ae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start _get_guest_xml network_info=[{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b0:48:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.base [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<a8288776-acfb-4289-842e-d7c0139ee2ae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'numa_topology' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.base [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<a8288776-acfb-4289-842e-d7c0139ee2ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.base [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<a8288776-acfb-4289-842e-d7c0139ee2ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-334211179',display_name='tempest-ServerRescueNegativeTestJSON-server-334211179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-334211179',id=31,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXCLPNRahrwnC+gKnfZ5AmrvDDoFntWf7hmadnHLR08PWgzTreG/rfjr60+7V6AI8ycGWsaXQ0AnQmcn38mLtrgREkWf0GOxm60960OmjMyLJ9FX7NLtj1q2nVtwO/ECw==',key_name='tempest-keypair-1932288392',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-b51qnsl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:04:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=a8288776-acfb-4289-842e-d7c0139ee2ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b0:48:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "vif_mac": "fa:16:3e:b0:48:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'pci_devices' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.objects.base [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Object Instance<a8288776-acfb-4289-842e-d7c0139ee2ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:06:08 user nova-compute[73458]:   <uuid>a8288776-acfb-4289-842e-d7c0139ee2ae</uuid>
Aug 27 01:06:08 user nova-compute[73458]:   <name>instance-0000001f</name>
Aug 27 01:06:08 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:06:08 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:06:08 user nova-compute[73458]:   <metadata>
Aug 27 01:06:08 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:06:08 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-334211179</nova:name>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:06:08</nova:creationTime>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:06:08 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:06:08 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:owner>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:user uuid="b1a7573d764b4cc0a7af57c45323c4f9">tempest-ServerRescueNegativeTestJSON-859054648-project-member</nova:user>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:project uuid="dd1972e3c8fd486bac81a90b489714ad">tempest-ServerRescueNegativeTestJSON-859054648</nova:project>
Aug 27 01:06:08 user nova-compute[73458]:       </nova:owner>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:06:08 user nova-compute[73458]:       <nova:ports>
Aug 27 01:06:08 user nova-compute[73458]:         <nova:port uuid="b1631295-d177-4f28-b28c-e9f333c0182e">
Aug 27 01:06:08 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 01:06:08 user nova-compute[73458]:         </nova:port>
Aug 27 01:06:08 user nova-compute[73458]:       </nova:ports>
Aug 27 01:06:08 user nova-compute[73458]:     </nova:instance>
Aug 27 01:06:08 user nova-compute[73458]:   </metadata>
Aug 27 01:06:08 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:06:08 user nova-compute[73458]:     <system>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="serial">a8288776-acfb-4289-842e-d7c0139ee2ae</entry>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="uuid">a8288776-acfb-4289-842e-d7c0139ee2ae</entry>
Aug 27 01:06:08 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:06:08 user nova-compute[73458]:     </system>
Aug 27 01:06:08 user nova-compute[73458]:   </sysinfo>
Aug 27 01:06:08 user nova-compute[73458]:   <os>
Aug 27 01:06:08 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:06:08 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:06:08 user nova-compute[73458]:   </os>
Aug 27 01:06:08 user nova-compute[73458]:   <features>
Aug 27 01:06:08 user nova-compute[73458]:     <acpi/>
Aug 27 01:06:08 user nova-compute[73458]:     <apic/>
Aug 27 01:06:08 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:06:08 user nova-compute[73458]:   </features>
Aug 27 01:06:08 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:06:08 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:06:08 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:06:08 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:06:08 user nova-compute[73458]:   </clock>
Aug 27 01:06:08 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:06:08 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:06:08 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:06:08 user nova-compute[73458]:   </cpu>
Aug 27 01:06:08 user nova-compute[73458]:   <devices>
Aug 27 01:06:08 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:06:08 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:06:08 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue"/>
Aug 27 01:06:08 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:06:08 user nova-compute[73458]:     </disk>
Aug 27 01:06:08 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:06:08 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:06:08 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk"/>
Aug 27 01:06:08 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 01:06:08 user nova-compute[73458]:     </disk>
Aug 27 01:06:08 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:06:08 user nova-compute[73458]:       <mac address="fa:16:3e:b0:48:1b"/>
Aug 27 01:06:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:06:08 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:06:08 user nova-compute[73458]:       <target dev="tapb1631295-d1"/>
Aug 27 01:06:08 user nova-compute[73458]:     </interface>
Aug 27 01:06:08 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:06:08 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/console.log" append="off"/>
Aug 27 01:06:08 user nova-compute[73458]:     </serial>
Aug 27 01:06:08 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:06:08 user nova-compute[73458]:     <video>
Aug 27 01:06:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:06:08 user nova-compute[73458]:     </video>
Aug 27 01:06:08 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:06:08 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:06:08 user nova-compute[73458]:     </rng>
Aug 27 01:06:08 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:06:08 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:06:08 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:06:08 user nova-compute[73458]:     </memballoon>
Aug 27 01:06:08 user nova-compute[73458]:   </devices>
Aug 27 01:06:08 user nova-compute[73458]: </domain>
Aug 27 01:06:08 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:06:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance destroyed successfully.
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] No VIF found with MAC fa:16:3e:b0:48:1b, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:09 user nova-compute[73458]: WARNING nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state active and task_state rescuing.
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:09 user nova-compute[73458]: WARNING nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:09 user nova-compute[73458]: WARNING nova.compute.manager [req-f477743d-1983-4105-bfca-6f6a9b966483 req-f54f86db-710d-4fee-800f-6055833c719a service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 01:06:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRNhUHdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:06:09 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:09 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:09 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9143475c-20fe-4e6d-8530-20d43056813b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:06:09 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353f09b-8e16-45ee-8cd5-7802b9314894]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b] added
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432e2f8-c8c2-4c9a-ac4d-1d3e83f59aba]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503bfaa-8ed6-42b8-b987-34ff900f9eca]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRNhUHdE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRNhUHdE" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a508967-7fd7-437d-a4ec-4679a2863966]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRNhUHdE'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588d446-82ad-4ab0-ab3c-b9504998f6cb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bd89e-00f6-418c-8458-344f427c541e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2df0d52-9a16-430b-80cc-ef05d6dd0376]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260]
Aug 27 01:06:09 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260] successful.
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[30564876-38a1-4368-a1ae-6392d48d4e1a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ca2ab-5d42-4784-aa77-d882f0b0b90b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:09 user nova-compute[73458]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)
Aug 27 01:06:09 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5a68c-a2dc-4da4-b503-2f63187f35a5]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:06:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRNhUHdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23236643638323136', 'path': '/dev/sdh'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236643638323136', 'path': '/dev/sdh'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:06:10 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:10 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 01:06:10 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:10 user nova-compute[73458]:   <serial>78b55ec3-b841-4fc3-ad50-407547919f1b</serial>
Aug 27 01:06:10 user nova-compute[73458]: </disk>
Aug 27 01:06:10 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:11 user nova-compute[73458]: WARNING nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state active and task_state rescuing.
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:11 user nova-compute[73458]: WARNING nova.compute.manager [req-4c4d701e-fadb-457b-a225-378912483564 req-f2d84c88-da39-4cf8-b0dc-cd0295f294a4 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state active and task_state rescuing.
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No VIF found with MAC fa:16:3e:01:76:b9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd8650c-b531-4d7c-8cf7-58a6944d7d10 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.308s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098371.811994, 8db27216-5890-41da-8297-c8f5c36b0d33 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Resumed (Lifecycle Event)
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:06:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance spawned successfully.
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:06:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098371.813641, 8db27216-5890-41da-8297-c8f5c36b0d33 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Started (Lifecycle Event)
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:06:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca150986-b492-429a-b6b2-69528a14e1e4 tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.437s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for a8288776-acfb-4289-842e-d7c0139ee2ae due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098372.4079483, a8288776-acfb-4289-842e-d7c0139ee2ae => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Resumed (Lifecycle Event)
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-af541fd2-da81-46f3-853f-0a1c8f126508 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:06:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098372.4104185, a8288776-acfb-4289-842e-d7c0139ee2ae => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Started (Lifecycle Event)
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:06:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:14 user nova-compute[73458]: INFO nova.compute.manager [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Detaching volume 78b55ec3-b841-4fc3-ad50-407547919f1b
Aug 27 01:06:14 user nova-compute[73458]: INFO nova.virt.block_device [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Attempting to driver detach volume 78b55ec3-b841-4fc3-ad50-407547919f1b from mountpoint /dev/vdb
Aug 27 01:06:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Attempting to detach device vdb from instance f714a2a9-c211-4881-9555-97ab44333f9c from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:06:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:06:14 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:14 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 01:06:14 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:14 user nova-compute[73458]:   <serial>78b55ec3-b841-4fc3-ad50-407547919f1b</serial>
Aug 27 01:06:14 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:06:14 user nova-compute[73458]: </disk>
Aug 27 01:06:14 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:06:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully detached device vdb from instance f714a2a9-c211-4881-9555-97ab44333f9c from the persistent domain config.
Aug 27 01:06:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f714a2a9-c211-4881-9555-97ab44333f9c from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:06:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:06:14 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:14 user nova-compute[73458]:   <source dev="/dev/sdh"/>
Aug 27 01:06:14 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:14 user nova-compute[73458]:   <serial>78b55ec3-b841-4fc3-ad50-407547919f1b</serial>
Aug 27 01:06:14 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:06:14 user nova-compute[73458]: </disk>
Aug 27 01:06:14 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098375.1770363, f714a2a9-c211-4881-9555-97ab44333f9c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:06:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully detached device vdb from instance f714a2a9-c211-4881-9555-97ab44333f9c from the live domain config.
Aug 27 01:06:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRNhUHdE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:06:15 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c728c-1769-48d2-9c04-c0733fb9e0b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5544012-8e4d-476f-8592-b39acb12bfad]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)
Aug 27 01:06:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:15 user nova-compute[73458]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b (non-flash)
Aug 27 01:06:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e785423b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b'): ({'sdh'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Removing single pathed devices sdh {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dae444-37a7-434b-a1b1-f72641938e17]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[865ddf15-fe55-4b76-82d9-6c4954c4f114]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flushing IO for device /dev/sdh {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4d510-3966-41ef-8fbd-9098f4ffce04]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a3c49-1a1c-433d-b188-c82bba256d1b]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] SCSI volumes sdh have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945530e-86a0-401a-9fc9-3cfdb8ba7ff1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d4aae6-73f5-48c4-84d3-3ee50b140d5c]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260]
Aug 27 01:06:15 user nova-compute[73458]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b, portal: 172.16.0.220,3260] successful.
Aug 27 01:06:15 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78b55ec3-b841-4fc3-ad50-407547919f1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[534507cc-12e8-414c-bbdd-5c409370f65a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== disconnect_volume: return (334ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:06:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:06:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2fd6865b-eac4-4219-9c42-6b8dd30e0dd4 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:26 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:06:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:36 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:36 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:06:36 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=6899MB free_disk=25.145893096923828GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:36 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Applying migration context for instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 as it has an incoming, in-progress migration 44beaa56-3684-41e0-90c2-94a4fbd80288. Migration status is finished {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 01:06:36 user nova-compute[73458]: INFO nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating resource usage from migration 44beaa56-3684-41e0-90c2-94a4fbd80288
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4571e0b0-c12a-407c-845e-67bc2a7480bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Migration 44beaa56-3684-41e0-90c2-94a4fbd80288 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8db27216-5890-41da-8297-c8f5c36b0d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:37 user nova-compute[73458]: INFO nova.compute.manager [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Detaching volume bcdf422e-ede0-4864-983f-646bf05f6627
Aug 27 01:06:37 user nova-compute[73458]: INFO nova.virt.block_device [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Attempting to driver detach volume bcdf422e-ede0-4864-983f-646bf05f6627 from mountpoint /dev/vdb
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Attempting to detach device vdb from instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:06:37 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:37 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:06:37 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:37 user nova-compute[73458]:   <serial>bcdf422e-ede0-4864-983f-646bf05f6627</serial>
Aug 27 01:06:37 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:06:37 user nova-compute[73458]: </disk>
Aug 27 01:06:37 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:06:37 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae from the persistent domain config.
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:06:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:06:37 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:06:37 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:06:37 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:06:37 user nova-compute[73458]:   <serial>bcdf422e-ede0-4864-983f-646bf05f6627</serial>
Aug 27 01:06:37 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:06:37 user nova-compute[73458]: </disk>
Aug 27 01:06:37 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098398.181309, 8055c2cc-8537-4968-a051-b3fa7d2eb3ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:06:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae from the live domain config.
Aug 27 01:06:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zcIvpYXb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:06:38 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[13273b7c-10ad-4212-b9ce-4de2a66b8e67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[56553883-f9c1-4bf2-b419-4108edee620d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:06:38 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:06:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e984ed240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e5b44-4d17-454f-9e9d-ae1591972be7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883eac8-1a1e-4494-8efe-1736be71db95]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[009601a9-f7c9-4e6e-840e-fd9eb8cc1066]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b365bcc-84bb-4304-a50d-c28a49d313bc]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf049572-6d6f-46ec-a287-9a911d3164bf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[489fe0b3-a6f5-4c66-b771-3b7e7bccbdfd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260]
Aug 27 01:06:38 user nova-compute[73458]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627, portal: 172.16.0.220,3260] successful.
Aug 27 01:06:38 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcdf422e-ede0-4864-983f-646bf05f6627 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a3ed9c-2ea6-406a-af0e-266e6e17d34a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== disconnect_volume: return (322ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:06:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:06:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:39 user nova-compute[73458]: DEBUG nova.objects.instance [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-5d80be9c-5c19-4a14-a6eb-a53e05561528 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.851s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: INFO nova.compute.manager [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Terminating instance
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-unplugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] No waiting events found dispatching network-vif-unplugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-2e0cc2fe-3e65-46d6-9f10-357383be0bc7 req-a57774a6-91da-46ff-93c0-b4f80bb790ab service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-unplugged-7505a9ae-0f36-4387-b971-1e34f396150e for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:06:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Instance destroyed successfully.
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lazy-loading 'resources' on Instance uuid 4571e0b0-c12a-407c-845e-67bc2a7480bb {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1962389743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1962389',id=28,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkR31ZV0TKbDYohJkLQQfMVDz/uoSkKv5lfbx8w4Cfp+f6P79RyqcxRQ1sve2x6e626E6SI/IK62P89A+I1fBvHAd3t+ySC0giMSaA8eW/w8IGMzeX3oGrAYS3gsamG3A==',key_name='tempest-keypair-178097356',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00575e7e8e7745f1ba0a0045aed0a413',ramdisk_id='',reservation_id='r-vg2z5ks5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34490a3d9e9f44b48df7d2c4082e48f9',uuid=4571e0b0-c12a-407c-845e-67bc2a7480bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converting VIF {"id": "7505a9ae-0f36-4387-b971-1e34f396150e", "address": "fa:16:3e:55:a4:66", "network": {"id": "f9f30d1c-3ce4-414e-9070-b604aeebf5ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-251169808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00575e7e8e7745f1ba0a0045aed0a413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7505a9ae-0f", "ovs_interfaceid": "7505a9ae-0f36-4387-b971-1e34f396150e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG os_vif [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7505a9ae-0f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:06:41 user nova-compute[73458]: INFO os_vif [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:a4:66,bridge_name='br-int',has_traffic_filtering=True,id=7505a9ae-0f36-4387-b971-1e34f396150e,network=Network(f9f30d1c-3ce4-414e-9070-b604aeebf5ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7505a9ae-0f')
Aug 27 01:06:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Deleting instance files /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb_del
Aug 27 01:06:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Deletion of /opt/stack/data/nova/instances/4571e0b0-c12a-407c-845e-67bc2a7480bb_del complete
Aug 27 01:06:41 user nova-compute[73458]: INFO nova.compute.manager [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 01:06:41 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:06:41 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:06:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:06:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:06:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:06:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updating instance_info_cache with network_info: [{"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-2317c1cf-8971-489e-928f-93a3a0ddf2b8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:06:43 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Took 1.49 seconds to deallocate network for instance.
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] Acquiring lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] No waiting events found dispatching network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:06:43 user nova-compute[73458]: WARNING nova.compute.manager [req-a93e1f78-74d7-46cd-bd30-91998b273de8 req-5833616f-7592-4779-b0c3-4329f7217577 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received unexpected event network-vif-plugged-7505a9ae-0f36-4387-b971-1e34f396150e for instance with vm_state active and task_state deleting.
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-c77f7d30-8a88-4125-9def-7fc61f597049 req-4da98cdc-e4b3-4583-bdd3-fa743e43f632 service nova] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Received event network-vif-deleted-7505a9ae-0f36-4387-b971-1e34f396150e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:06:43 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:06:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:44 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Deleted allocations for instance 4571e0b0-c12a-407c-845e-67bc2a7480bb
Aug 27 01:06:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b2872a41-9469-46b9-9df8-3a4263e0d33f tempest-TestServerVolumeAttachScenarioOldVersion-1209232957 tempest-TestServerVolumeAttachScenarioOldVersion-1209232957-project-member] Lock "4571e0b0-c12a-407c-845e-67bc2a7480bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:06:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098401.855711, 4571e0b0-c12a-407c-845e-67bc2a7480bb => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:06:56 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] VM Stopped (Lifecycle Event)
Aug 27 01:06:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-91842117-a84a-4f55-9534-4aa3bfef3ab3 None None] [instance: 4571e0b0-c12a-407c-845e-67bc2a7480bb] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:06:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:06 user nova-compute[73458]: INFO nova.compute.manager [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Detaching volume cf681136-6dc4-4202-978b-15e6b267aac1
Aug 27 01:07:06 user nova-compute[73458]: INFO nova.virt.block_device [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Attempting to driver detach volume cf681136-6dc4-4202-978b-15e6b267aac1 from mountpoint /dev/vdb
Aug 27 01:07:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Attempting to detach device vdb from instance 64b863a7-f34f-4188-be01-4a89b1248368 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:07:06 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:07:06 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:07:06 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:07:06 user nova-compute[73458]:   <serial>cf681136-6dc4-4202-978b-15e6b267aac1</serial>
Aug 27 01:07:06 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:07:06 user nova-compute[73458]: </disk>
Aug 27 01:07:06 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:07:06 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdb from instance 64b863a7-f34f-4188-be01-4a89b1248368 from the persistent domain config.
Aug 27 01:07:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64b863a7-f34f-4188-be01-4a89b1248368 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:07:06 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:07:06 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:07:06 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:07:06 user nova-compute[73458]:   <serial>cf681136-6dc4-4202-978b-15e6b267aac1</serial>
Aug 27 01:07:06 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:07:06 user nova-compute[73458]: </disk>
Aug 27 01:07:06 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:07:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098427.1960125, 64b863a7-f34f-4188-be01-4a89b1248368 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:07:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdb from instance 64b863a7-f34f-4188-be01-4a89b1248368 from the live domain config.
Aug 27 01:07:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cvtJsjWT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:07:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddff02f-bea5-4210-90e8-b94ff0994545]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0272a9-6d5d-4183-ac31-4c0e915ba6e5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:07:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:07:07 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:07:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78687f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[203ad628-5d89-4b50-b33b-622727ce19e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2eea9d-f3b2-4043-ac74-9a8f5c893f8e]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec640947-2866-4d41-8648-1d9afa9afd1a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5657458f-426b-46e8-986c-b878fe7fa6d7]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5072587e-cd09-4334-8813-2c6ab0dc15d6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[645c7444-1f4b-4382-9e11-16ce398cbcd2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260]
Aug 27 01:07:07 user nova-compute[73458]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1, portal: 172.16.0.220,3260] successful.
Aug 27 01:07:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf681136-6dc4-4202-978b-15e6b267aac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6c7573-6b54-4462-9752-30686344fb44]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== disconnect_volume: return (293ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:07:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-78a02939-d7e1-4c5c-a164-323467c94a2f tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.734s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73458) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 01:07:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:09 user nova-compute[73458]: WARNING nova.compute.manager [req-c8189fd4-45a9-478a-a3a9-fc4fc11d056f req-a1131727-afdb-4175-b8ce-a0abb3db918f service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state active and task_state powering-off.
Aug 27 01:07:09 user nova-compute[73458]: INFO nova.compute.manager [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Rescuing
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:07:09 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance destroyed successfully.
Aug 27 01:07:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dc0d37a9-dc5f-4ad6-83ec-92bb997d9305 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.893s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance destroyed successfully.
Aug 27 01:07:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Attempting a stable device rescue
Aug 27 01:07:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73458) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance directory exists: not creating {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 01:07:10 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Creating image(s)
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "7c0589b385972f9be800f37a529c2d57cfc27f33" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "7c0589b385972f9be800f37a529c2d57cfc27f33" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:11 user nova-compute[73458]: WARNING nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state None.
Aug 27 01:07:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:12 user nova-compute[73458]: WARNING nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state rescuing.
Aug 27 01:07:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:12 user nova-compute[73458]: WARNING nova.compute.manager [req-87284f37-cda6-4ac7-b476-ed757492ce53 req-607199aa-a702-4a4c-93d3-4dfc5d4b0819 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state rescuing.
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.part --force-share --output=json" returned: 0 in 0.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG nova.virt.images [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ff8e48f7-3cc4-45a9-bac6-fc932f81b8ca was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.part /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.part /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.converted" returned: 0 in 0.478s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "7c0589b385972f9be800f37a529c2d57cfc27f33" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "7c0589b385972f9be800f37a529c2d57cfc27f33" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "7c0589b385972f9be800f37a529c2d57cfc27f33" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33 --force-share --output=json" returned: 0 in 0.215s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33,backing_fmt=raw /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33,backing_fmt=raw /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue" returned: 0 in 0.120s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "7c0589b385972f9be800f37a529c2d57cfc27f33" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'migration_context' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<8fa53972-0393-4835-8139-e03fa0a64f42> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start _get_guest_xml network_info=[{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:f1:40:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff8e48f7-3cc4-45a9-bac6-fc932f81b8ca', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '8fa53972-0393-4835-8139-e03fa0a64f42', 'attached_at': '', 'detached_at': '', 'volume_id': 'a71c1667-6e9a-4998-ad28-75548ca012c4', 'serial': 'a71c1667-6e9a-4998-ad28-75548ca012c4'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '7ed0e4ff-bfda-4f4b-8925-328ed85df36a', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<8fa53972-0393-4835-8139-e03fa0a64f42> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<8fa53972-0393-4835-8139-e03fa0a64f42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:13 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:13 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<8fa53972-0393-4835-8139-e03fa0a64f42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:07:13 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:07:13 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:07:13 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd82a36-6795-4209-b3d3-a142977115ef]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oLWycZQl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 01:07:13 user nova-compute[73458]: node.name = iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4
Aug 27 01:07:13 user nova-compute[73458]: node.tpgt = -1
Aug 27 01:07:13 user nova-compute[73458]: node.startup = automatic
Aug 27 01:07:13 user nova-compute[73458]: node.leading_login = No
Aug 27 01:07:13 user nova-compute[73458]: iface.iscsi_ifacename = default
Aug 27 01:07:13 user nova-compute[73458]: iface.net_ifacename = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.ipaddress = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.prefix_len = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.hwaddress = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.transport_name = tcp
Aug 27 01:07:13 user nova-compute[73458]: iface.initiatorname = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.vlan_id = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.vlan_priority = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.vlan_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.iface_num = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.mtu = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.port = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.bootproto = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.subnet_mask = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.gateway = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_alt_client_id = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_dns = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_learn_iqn = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_vendor_id_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_vendor_id = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.dhcp_slp_da = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.fragmentation = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.gratuitous_arp = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.incoming_forwarding = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.tos_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.tos = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.ttl = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.delayed_ack = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.tcp_nagle = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.tcp_wsf_state = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.tcp_wsf = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.tcp_timer_scale = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.tcp_timestamp = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.redirect = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.def_task_mgmt_timeout = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.header_digest = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.data_digest = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.immediate_data = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.initial_r2t = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.data_seq_inorder = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.data_pdu_inorder = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.erl = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.max_receive_data_len = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.first_burst_len = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.max_outstanding_r2t = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.max_burst_len = 0
Aug 27 01:07:13 user nova-compute[73458]: iface.chap_auth = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.bidi_chap = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.strict_login_compliance = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.discovery_auth = <empty>
Aug 27 01:07:13 user nova-compute[73458]: iface.discovery_logout = <empty>
Aug 27 01:07:13 user nova-compute[73458]: node.discovery_address = <empty>
Aug 27 01:07:13 user nova-compute[73458]: node.discovery_port = 0
Aug 27 01:07:13 user nova-compute[73458]: node.discovery_type = static
Aug 27 01:07:13 user nova-compute[73458]: node.session.initial_cmdsn = 0
Aug 27 01:07:13 user nova-compute[73458]: node.session.initial_login_retry_max = 8
Aug 27 01:07:13 user nova-compute[73458]: node.session.xmit_thread_priority = -20
Aug 27 01:07:13 user nova-compute[73458]: node.session.cmds_max = 128
Aug 27 01:07:13 user nova-compute[73458]: node.session.queue_depth = 32
Aug 27 01:07:13 user nova-compute[73458]: node.session.nr_sessions = 1
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.authmethod = CHAP
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.username = oLWycZQl
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.password = ***
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.username_in = <empty>
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.password_in = <empty>
Aug 27 01:07:13 user nova-compute[73458]: node.session.auth.chap_algs = MD5
Aug 27 01:07:13 user nova-compute[73458]: node.session.timeo.replacement_timeout = 120
Aug 27 01:07:13 user nova-compute[73458]: node.session.err_timeo.abort_timeout = 15
Aug 27 01:07:13 user nova-compute[73458]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 01:07:13 user nova-compute[73458]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 01:07:13 user nova-compute[73458]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.FastAbort = Yes
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.InitialR2T = No
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.ImmediateData = Yes
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.MaxConnections = 1
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 01:07:13 user nova-compute[73458]: node.session.iscsi.ERL = 0
Aug 27 01:07:13 user nova-compute[73458]: node.session.scan = manual
Aug 27 01:07:13 user nova-compute[73458]: node.session.reopen_max = 0
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].address = 172.16.0.220
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].port = 3260
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].startup = manual
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].tcp.window_size = 524288
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].tcp.type_of_service = 0
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].timeo.logout_timeout = 15
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].timeo.login_timeout = 15
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].timeo.auth_timeout = 45
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.DataDigest = None
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.IFMarker = No
Aug 27 01:07:13 user nova-compute[73458]: node.conn[0].iscsi.OFMarker = No
Aug 27 01:07:13 user nova-compute[73458]: # END RECORD
Aug 27 01:07:13 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7656ccc-736d-4453-b55a-a54dda17fbff]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1d21b-293a-47cc-9c7e-bdf0dec2bdc7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLWycZQl {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oLWycZQl" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ce05a-3e4e-43d7-9cc5-00336d382167]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oLWycZQl'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[728cfced-decc-4657-9e1d-406e0cfddb57]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2bc1f5-02c9-4ecf-90ea-f319356bbc89]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:07:13 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:07:13 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:07:13 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.141s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] HCTL ('37', '0', '0', 0) found on session 34 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea523f3b-a123-41e3-9daa-aa66dd703800]: (4, ('0 0 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Searching for a device in session 34 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23436323166353330', 'path': '/dev/sdf'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436323166353330', 'path': '/dev/sdf'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908692436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908692436',id=33,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-nx2zr64e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:05:49Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=8fa53972-0393-4835-8139-e03fa0a64f42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:f1:40:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "vif_mac": "fa:16:3e:f1:40:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Object Instance<8fa53972-0393-4835-8139-e03fa0a64f42> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:07:13 user nova-compute[73458]:   <uuid>8fa53972-0393-4835-8139-e03fa0a64f42</uuid>
Aug 27 01:07:13 user nova-compute[73458]:   <name>instance-00000021</name>
Aug 27 01:07:13 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:07:13 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:07:13 user nova-compute[73458]:   <metadata>
Aug 27 01:07:13 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:07:13 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1908692436</nova:name>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:07:13</nova:creationTime>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:07:13 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:07:13 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:owner>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:user uuid="9a452f9412de4c8d881d30b02c01d3a9">tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member</nova:user>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:project uuid="3537b33489d84282958ddf05f58ade1e">tempest-ServerBootFromVolumeStableRescueTest-635602081</nova:project>
Aug 27 01:07:13 user nova-compute[73458]:       </nova:owner>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:07:13 user nova-compute[73458]:       <nova:ports>
Aug 27 01:07:13 user nova-compute[73458]:         <nova:port uuid="8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81">
Aug 27 01:07:13 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 01:07:13 user nova-compute[73458]:         </nova:port>
Aug 27 01:07:13 user nova-compute[73458]:       </nova:ports>
Aug 27 01:07:13 user nova-compute[73458]:     </nova:instance>
Aug 27 01:07:13 user nova-compute[73458]:   </metadata>
Aug 27 01:07:13 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:07:13 user nova-compute[73458]:     <system>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="serial">8fa53972-0393-4835-8139-e03fa0a64f42</entry>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="uuid">8fa53972-0393-4835-8139-e03fa0a64f42</entry>
Aug 27 01:07:13 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:07:13 user nova-compute[73458]:     </system>
Aug 27 01:07:13 user nova-compute[73458]:   </sysinfo>
Aug 27 01:07:13 user nova-compute[73458]:   <os>
Aug 27 01:07:13 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:07:13 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:07:13 user nova-compute[73458]:   </os>
Aug 27 01:07:13 user nova-compute[73458]:   <features>
Aug 27 01:07:13 user nova-compute[73458]:     <acpi/>
Aug 27 01:07:13 user nova-compute[73458]:     <apic/>
Aug 27 01:07:13 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:07:13 user nova-compute[73458]:   </features>
Aug 27 01:07:13 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:07:13 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:07:13 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:07:13 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:07:13 user nova-compute[73458]:   </clock>
Aug 27 01:07:13 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:07:13 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:07:13 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:07:13 user nova-compute[73458]:   </cpu>
Aug 27 01:07:13 user nova-compute[73458]:   <devices>
Aug 27 01:07:13 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:07:13 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:07:13 user nova-compute[73458]:       <source dev="/dev/sdf"/>
Aug 27 01:07:13 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:07:13 user nova-compute[73458]:       <serial>a71c1667-6e9a-4998-ad28-75548ca012c4</serial>
Aug 27 01:07:13 user nova-compute[73458]:     </disk>
Aug 27 01:07:13 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:07:13 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:07:13 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue"/>
Aug 27 01:07:13 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 01:07:13 user nova-compute[73458]:       <boot order="1"/>
Aug 27 01:07:13 user nova-compute[73458]:     </disk>
Aug 27 01:07:13 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:07:13 user nova-compute[73458]:       <mac address="fa:16:3e:f1:40:15"/>
Aug 27 01:07:13 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:07:13 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:07:13 user nova-compute[73458]:       <target dev="tap8e4330f6-6a"/>
Aug 27 01:07:13 user nova-compute[73458]:     </interface>
Aug 27 01:07:13 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:07:13 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/console.log" append="off"/>
Aug 27 01:07:13 user nova-compute[73458]:     </serial>
Aug 27 01:07:13 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:07:13 user nova-compute[73458]:     <video>
Aug 27 01:07:13 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:07:13 user nova-compute[73458]:     </video>
Aug 27 01:07:13 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:07:13 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:07:13 user nova-compute[73458]:     </rng>
Aug 27 01:07:13 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:07:13 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:07:13 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:07:13 user nova-compute[73458]:     </memballoon>
Aug 27 01:07:13 user nova-compute[73458]:   </devices>
Aug 27 01:07:13 user nova-compute[73458]: </domain>
Aug 27 01:07:13 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:07:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance destroyed successfully.
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:07:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] No VIF found with MAC fa:16:3e:f1:40:15, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:07:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:15 user nova-compute[73458]: WARNING nova.compute.manager [req-0f8babf8-958d-46b9-b317-494c6bce0b05 req-f2b5251a-6a26-459a-917c-72af2b652016 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state rescuing.
Aug 27 01:07:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:15 user nova-compute[73458]: INFO nova.compute.manager [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] instance snapshotting
Aug 27 01:07:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Beginning live snapshot process
Aug 27 01:07:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json -f qcow2 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7.delta 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7.delta 1073741824" returned: 0 in 0.050s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:16 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 01:07:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] COPY block job progress, current cursor: 196608 final cursor: 75563008 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 8fa53972-0393-4835-8139-e03fa0a64f42 due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098437.1733587, 8fa53972-0393-4835-8139-e03fa0a64f42 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Resumed (Lifecycle Event)
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:17 user nova-compute[73458]: WARNING nova.compute.manager [req-eee2a92c-e38f-4c5d-a3ed-0d11f2d48d6b req-5b58f02f-f4ae-45ff-a0b8-73e05af0101c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state rescuing.
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-afcf4860-9576-4a2f-a814-ff891de60738 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:07:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098437.1750293, 8fa53972-0393-4835-8139-e03fa0a64f42 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Started (Lifecycle Event)
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73458) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 01:07:17 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 01:07:17 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:07:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7.delta /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7.delta /opt/stack/data/nova/instances/snapshots/tmpkhn50m1p/7596a67fd32a4c5f9d3cd5b53dd6d3c7" returned: 0 in 0.379s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:18 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Snapshot extracted, beginning image upload
Aug 27 01:07:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Snapshot image upload complete
Aug 27 01:07:20 user nova-compute[73458]: INFO nova.compute.manager [None req-0edc8a5a-5852-40c0-b308-7a5f545fc6d2 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Took 5.06 seconds to snapshot the instance on the hypervisor.
Aug 27 01:07:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:07:23 user nova-compute[73458]: INFO nova.compute.claims [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Claim successful on node user
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:07:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:07:23 user nova-compute[73458]: DEBUG nova.policy [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c2d32f72d1b492a8547216dd6ab76ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19dbd4016f794fa180f1107d67f46e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:07:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Creating image(s)
Aug 27 01:07:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "/opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "/opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098429.7387, 64b863a7-f34f-4188-be01-4a89b1248368 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:25 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Stopped (Lifecycle Event)
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Successfully created port: b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c88d212a-76fc-4ed9-9e3f-9c6221cb5e30 None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c88d212a-76fc-4ed9-9e3f-9c6221cb5e30 None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.virt.images [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] e5a3ab87-ec9e-42ac-899c-88a6505ebd0c was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.part /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.part /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.converted" returned: 0 in 0.354s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.784s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Successfully updated port: b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Going to confirm migration 2 {{(pid=73458) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquired lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing instance network info cache due to event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] Acquiring lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c,backing_fmt=raw /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c,backing_fmt=raw /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk 1073741824" returned: 0 in 0.051s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c5d1422b07fdc5391d5cfd992993f25f9083786c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquired lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'info_cache' on Instance uuid 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Ensure instance console log exists: /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating instance_info_cache with network_info: [{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Releasing lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Instance network_info: |[{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] Acquired lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Start _get_guest_xml network_info=[{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='acf25e3e33f132242ef1a2b2b49653c5',container_format='bare',created_at=2023-08-27T01:07:15Z,direct_url=<?>,disk_format='qcow2',id=e5a3ab87-ec9e-42ac-899c-88a6505ebd0c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1155321047',owner='19dbd4016f794fa180f1107d67f46e8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T01:07:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': 'e5a3ab87-ec9e-42ac-899c-88a6505ebd0c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:07:26 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:26 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='acf25e3e33f132242ef1a2b2b49653c5',container_format='bare',created_at=2023-08-27T01:07:15Z,direct_url=<?>,disk_format='qcow2',id=e5a3ab87-ec9e-42ac-899c-88a6505ebd0c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1155321047',owner='19dbd4016f794fa180f1107d67f46e8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T01:07:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1625098460',display_name='tempest-TestStampPattern-server-1625098460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1625098460',id=34,image_ref='e5a3ab87-ec9e-42ac-899c-88a6505ebd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-ide830ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f714a2a9-c211-4881-9555-97ab44333f9c',image_min_disk='1',image_min_ram='0',image_owner_id='19dbd4016f794fa180f1107d67f46e8a',image_owner_project_name='tempest-TestStampPattern-650683177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-650683177-project-member',image_user_id='9c2d32f72d1b492a8547216dd6ab76ab',network_allocated='True',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:07:24Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=c7a0f8c6-ff97-4f68-b2b1-5856373026ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:07:26 user nova-compute[73458]:   <uuid>c7a0f8c6-ff97-4f68-b2b1-5856373026ff</uuid>
Aug 27 01:07:26 user nova-compute[73458]:   <name>instance-00000022</name>
Aug 27 01:07:26 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:07:26 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:07:26 user nova-compute[73458]:   <metadata>
Aug 27 01:07:26 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:07:26 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:name>tempest-TestStampPattern-server-1625098460</nova:name>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:07:26</nova:creationTime>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:07:26 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:07:26 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:owner>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:user uuid="9c2d32f72d1b492a8547216dd6ab76ab">tempest-TestStampPattern-650683177-project-member</nova:user>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:project uuid="19dbd4016f794fa180f1107d67f46e8a">tempest-TestStampPattern-650683177</nova:project>
Aug 27 01:07:26 user nova-compute[73458]:       </nova:owner>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:root type="image" uuid="e5a3ab87-ec9e-42ac-899c-88a6505ebd0c"/>
Aug 27 01:07:26 user nova-compute[73458]:       <nova:ports>
Aug 27 01:07:26 user nova-compute[73458]:         <nova:port uuid="b1af10fa-4f63-4b8e-abd4-dc06951fbe4f">
Aug 27 01:07:26 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 01:07:26 user nova-compute[73458]:         </nova:port>
Aug 27 01:07:26 user nova-compute[73458]:       </nova:ports>
Aug 27 01:07:26 user nova-compute[73458]:     </nova:instance>
Aug 27 01:07:26 user nova-compute[73458]:   </metadata>
Aug 27 01:07:26 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:07:26 user nova-compute[73458]:     <system>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="serial">c7a0f8c6-ff97-4f68-b2b1-5856373026ff</entry>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="uuid">c7a0f8c6-ff97-4f68-b2b1-5856373026ff</entry>
Aug 27 01:07:26 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:07:26 user nova-compute[73458]:     </system>
Aug 27 01:07:26 user nova-compute[73458]:   </sysinfo>
Aug 27 01:07:26 user nova-compute[73458]:   <os>
Aug 27 01:07:26 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:07:26 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:07:26 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:07:26 user nova-compute[73458]:   </os>
Aug 27 01:07:26 user nova-compute[73458]:   <features>
Aug 27 01:07:26 user nova-compute[73458]:     <acpi/>
Aug 27 01:07:26 user nova-compute[73458]:     <apic/>
Aug 27 01:07:26 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:07:26 user nova-compute[73458]:   </features>
Aug 27 01:07:26 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:07:26 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:07:26 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:07:26 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:07:26 user nova-compute[73458]:   </clock>
Aug 27 01:07:26 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:07:26 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:07:26 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:07:26 user nova-compute[73458]:   </cpu>
Aug 27 01:07:26 user nova-compute[73458]:   <devices>
Aug 27 01:07:26 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:07:26 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:07:26 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk"/>
Aug 27 01:07:26 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:07:26 user nova-compute[73458]:     </disk>
Aug 27 01:07:26 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:07:26 user nova-compute[73458]:       <mac address="fa:16:3e:c7:22:cd"/>
Aug 27 01:07:26 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:07:26 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:07:26 user nova-compute[73458]:       <target dev="tapb1af10fa-4f"/>
Aug 27 01:07:26 user nova-compute[73458]:     </interface>
Aug 27 01:07:26 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:07:26 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/console.log" append="off"/>
Aug 27 01:07:26 user nova-compute[73458]:     </serial>
Aug 27 01:07:26 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:07:26 user nova-compute[73458]:     <video>
Aug 27 01:07:26 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:07:26 user nova-compute[73458]:     </video>
Aug 27 01:07:26 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:07:26 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:07:26 user nova-compute[73458]:     </rng>
Aug 27 01:07:26 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:07:26 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:07:26 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:07:26 user nova-compute[73458]:     </memballoon>
Aug 27 01:07:26 user nova-compute[73458]:   </devices>
Aug 27 01:07:26 user nova-compute[73458]: </domain>
Aug 27 01:07:26 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1625098460',display_name='tempest-TestStampPattern-server-1625098460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1625098460',id=34,image_ref='e5a3ab87-ec9e-42ac-899c-88a6505ebd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-ide830ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f714a2a9-c211-4881-9555-97ab44333f9c',image_min_disk='1',image_min_ram='0',image_owner_id='19dbd4016f794fa180f1107d67f46e8a',image_owner_project_name='tempest-TestStampPattern-650683177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-650683177-project-member',image_user_id='9c2d32f72d1b492a8547216dd6ab76ab',network_allocated='True',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:07:24Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=c7a0f8c6-ff97-4f68-b2b1-5856373026ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG os_vif [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1af10fa-4f, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1af10fa-4f, col_values=(('external_ids', {'iface-id': 'b1af10fa-4f63-4b8e-abd4-dc06951fbe4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:22:cd', 'vm-uuid': 'c7a0f8c6-ff97-4f68-b2b1-5856373026ff'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:26 user nova-compute[73458]: INFO os_vif [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f')
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No VIF found with MAC fa:16:3e:c7:22:cd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updated VIF entry in instance network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating instance_info_cache with network_info: [{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f68406f0-aeb0-4923-83b8-403e643c617c req-8997e996-4427-4ded-9e8d-95e241f02956 service nova] Releasing lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.network.neutron [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [{"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Releasing lock "refresh_cache-27d4df7e-e2e2-4292-9a18-ae984b3be6a0" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'migration_context' on Instance uuid 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG nova.objects.base [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Object Instance<27d4df7e-e2e2-4292-9a18-ae984b3be6a0> lazy-loaded attributes: info_cache,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.532s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:27 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Deleted allocation for migration 44beaa56-3684-41e0-90c2-94a4fbd80288
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dba2382f-78fa-4a46-82c0-6cc22b031450 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.613s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.015s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:27 user nova-compute[73458]: INFO nova.compute.manager [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Terminating instance
Aug 27 01:07:27 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-unplugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] No waiting events found dispatching network-vif-unplugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-ece9e54a-39a9-450c-bfc3-cb8003719f2b req-b5cd7941-48b0-4266-82c6-ea273f8b1bfe service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-unplugged-ffe3801c-9435-4d65-b825-effc5233ee2b for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] No waiting events found dispatching network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:28 user nova-compute[73458]: WARNING nova.compute.manager [req-32e50acb-4b47-40db-afb2-5e385c4e684d req-a05c890f-b232-431a-91d2-3beeda2958fc service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received unexpected event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f for instance with vm_state building and task_state spawning.
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Instance destroyed successfully.
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.objects.instance [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'resources' on Instance uuid 8055c2cc-8537-4968-a051-b3fa7d2eb3ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-696224958',display_name='tempest-AttachVolumeNegativeTest-server-696224958',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-696224958',id=25,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLk1hWHhX5HBrEvNAkeU3mRQQr/fdlWO+/FtLRQElr2TXQ8ia5AYLy+e0aI6wkB3CPIxkLNcDGH/Gv4EGJ80JksPk4tnkkaoqFJEdrAqruL7/B0tF5KcXoF6vX46q+7YQ==',key_name='tempest-keypair-1630912845',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-z00v6fdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=8055c2cc-8537-4968-a051-b3fa7d2eb3ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "ffe3801c-9435-4d65-b825-effc5233ee2b", "address": "fa:16:3e:b6:12:14", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffe3801c-94", "ovs_interfaceid": "ffe3801c-9435-4d65-b825-effc5233ee2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG os_vif [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffe3801c-94, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:28 user nova-compute[73458]: INFO os_vif [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:12:14,bridge_name='br-int',has_traffic_filtering=True,id=ffe3801c-9435-4d65-b825-effc5233ee2b,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffe3801c-94')
Aug 27 01:07:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Deleting instance files /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae_del
Aug 27 01:07:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Deletion of /opt/stack/data/nova/instances/8055c2cc-8537-4968-a051-b3fa7d2eb3ae_del complete
Aug 27 01:07:28 user nova-compute[73458]: INFO nova.compute.manager [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 01:07:28 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:07:28 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:07:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:29 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:29 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Took 0.74 seconds to deallocate network for instance.
Aug 27 01:07:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Deleted allocations for instance 8055c2cc-8537-4968-a051-b3fa7d2eb3ae
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-3f6ab518-46bf-4515-84d4-68f8bfb87311 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] Acquiring lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] Lock "8055c2cc-8537-4968-a051-b3fa7d2eb3ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] No waiting events found dispatching network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:30 user nova-compute[73458]: WARNING nova.compute.manager [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received unexpected event network-vif-plugged-ffe3801c-9435-4d65-b825-effc5233ee2b for instance with vm_state deleted and task_state None.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-a50b4dd7-043c-4e9e-b52a-6cf7a8e162dd req-9e9bd7b0-373b-4345-b8aa-814d277d93bb service nova] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Received event network-vif-deleted-ffe3801c-9435-4d65-b825-effc5233ee2b {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] No waiting events found dispatching network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:30 user nova-compute[73458]: WARNING nova.compute.manager [req-0b539519-c3ae-4abe-9c9d-87f1fdefcca2 req-f28a2ebd-924c-4db1-a719-4c30a9df7d6b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received unexpected event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f for instance with vm_state building and task_state spawning.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098450.5509582, c7a0f8c6-ff97-4f68-b2b1-5856373026ff => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] VM Resumed (Lifecycle Event)
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Instance spawned successfully.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098450.5557365, c7a0f8c6-ff97-4f68-b2b1-5856373026ff => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] VM Started (Lifecycle Event)
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:07:30 user nova-compute[73458]: INFO nova.compute.manager [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Took 7.55 seconds to build instance.
Aug 27 01:07:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6167aed-8eca-42e5-92e9-a78bee56fdeb tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.644s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json" returned: 0 in 0.473s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:07:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:07:37 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:37 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:07:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7229MB free_disk=24.95948028564453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8db27216-5890-41da-8297-c8f5c36b0d33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098448.7040458, 8055c2cc-8537-4968-a051-b3fa7d2eb3ae => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:07:43 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] VM Stopped (Lifecycle Event)
Aug 27 01:07:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-35759efb-0bd9-45c2-b5ec-27efd63c3f40 None None] [instance: 8055c2cc-8537-4968-a051-b3fa7d2eb3ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:07:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [{"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8377d9b5-a8c1-48be-be16-be1ace928d3f" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:07:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:07:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:47 user nova-compute[73458]: INFO nova.compute.manager [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Terminating instance
Aug 27 01:07:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:07:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-edf0d425-a950-4f45-922a-72f7f4b592fa req-d36e238d-16ae-4ec6-967c-6b1630ba224c service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-unplugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:07:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Instance destroyed successfully.
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lazy-loading 'resources' on Instance uuid 8db27216-5890-41da-8297-c8f5c36b0d33 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T01:02:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1350033724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1350033724',id=26,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKybHO4sBlE9ZQP0/UdKOr+PWb5lDH3rEZXIDxVRoeNPc2IAB8zo3MRwYeFeKYrNNtFOuE7d/hyshrcCRhEFotMcShcBykIt49E1NvYewH87+/p7MY51p+w3ZDmZellbfg==',key_name='tempest-keypair-1675613778',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d726b2aaef554069ace63df4c4e92717',ramdisk_id='',reservation_id='r-a5ib7stt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-462549752',owner_user_name='tempest-AttachVolumeShelveTestJSON-462549752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='017197a0401c456f97c4260b62669916',uuid=8db27216-5890-41da-8297-c8f5c36b0d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converting VIF {"id": "5ab8536e-76a7-47f7-9671-fbde015141eb", "address": "fa:16:3e:7b:b5:72", "network": {"id": "f871852d-174e-47d1-928e-970c857c3975", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1038640262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d726b2aaef554069ace63df4c4e92717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab8536e-76", "ovs_interfaceid": "5ab8536e-76a7-47f7-9671-fbde015141eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG os_vif [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ab8536e-76, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:48 user nova-compute[73458]: INFO os_vif [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b5:72,bridge_name='br-int',has_traffic_filtering=True,id=5ab8536e-76a7-47f7-9671-fbde015141eb,network=Network(f871852d-174e-47d1-928e-970c857c3975),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab8536e-76')
Aug 27 01:07:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Deleting instance files /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33_del
Aug 27 01:07:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Deletion of /opt/stack/data/nova/instances/8db27216-5890-41da-8297-c8f5c36b0d33_del complete
Aug 27 01:07:48 user nova-compute[73458]: INFO nova.compute.manager [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 27 01:07:48 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:07:48 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:07:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:49 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:49 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Took 1.01 seconds to deallocate network for instance.
Aug 27 01:07:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:50 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Deleted allocations for instance 8db27216-5890-41da-8297-c8f5c36b0d33
Aug 27 01:07:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695b2b1c-a6f4-423c-b61f-05d4181a4e0f tempest-AttachVolumeShelveTestJSON-462549752 tempest-AttachVolumeShelveTestJSON-462549752-project-member] Lock "8db27216-5890-41da-8297-c8f5c36b0d33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] Acquiring lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] Lock "8db27216-5890-41da-8297-c8f5c36b0d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] No waiting events found dispatching network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:50 user nova-compute[73458]: WARNING nova.compute.manager [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received unexpected event network-vif-plugged-5ab8536e-76a7-47f7-9671-fbde015141eb for instance with vm_state deleted and task_state None.
Aug 27 01:07:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-730ed65f-10a8-4374-bffd-6a4164ca5a32 req-c8247edf-b98b-4c8a-a627-21ebbd674905 service nova] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Received event network-vif-deleted-5ab8536e-76a7-47f7-9671-fbde015141eb {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:56 user nova-compute[73458]: INFO nova.compute.manager [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Unrescuing
Aug 27 01:07:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:07:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:07:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'flavor' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:57 user nova-compute[73458]: WARNING nova.compute.manager [req-99a3324d-c061-4bda-8a23-e51a8f7a7b56 req-b89a55d5-72c7-4a49-ab2f-69d36c576595 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:57 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance destroyed successfully.
Aug 27 01:07:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:59 user nova-compute[73458]: WARNING nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:07:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:07:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:07:59 user nova-compute[73458]: WARNING nova.compute.manager [req-d5252432-69ee-4889-a710-f0b4ee0c2e9a req-c8958b31-54ad-4722-92f7-b7362165b507 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for a8288776-acfb-4289-842e-d7c0139ee2ae due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098481.4787595, a8288776-acfb-4289-842e-d7c0139ee2ae => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Resumed (Lifecycle Event)
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4e1eb755-87a3-44a8-b48e-9615c6c56e72 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098481.4803357, a8288776-acfb-4289-842e-d7c0139ee2ae => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:01 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Started (Lifecycle Event)
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:08:01 user nova-compute[73458]: WARNING nova.compute.manager [req-49ce21de-4d73-4e34-85cb-1249d7e3c1da req-f9ac4234-f9db-4503-b6da-cb6cbdf1fa39 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state active and task_state None.
Aug 27 01:08:03 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098468.6484094, 8db27216-5890-41da-8297-c8f5c36b0d33 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:03 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] VM Stopped (Lifecycle Event)
Aug 27 01:08:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8895915c-1ef3-440e-9d71-9e29bd464a85 None None] [instance: 8db27216-5890-41da-8297-c8f5c36b0d33] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:15 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:08:15 user nova-compute[73458]: INFO nova.compute.claims [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Claim successful on node user
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:08:16 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:08:16 user nova-compute[73458]: DEBUG nova.policy [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:08:16 user nova-compute[73458]: INFO nova.virt.block_device [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Booting with volume snapshot 155689cd-3c1a-4528-9777-2c2039474001 at /dev/vda
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Successfully created port: c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Successfully updated port: c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-changed-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Refreshing instance network info cache due to event network-changed-c8ff8c93-08a7-4ead-a04b-f9231ef10558. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] Acquiring lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updating instance_info_cache with network_info: [{"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Instance network_info: |[{"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] Acquired lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Refreshing network info cache for port c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updated VIF entry in instance network info cache for port c8ff8c93-08a7-4ead-a04b-f9231ef10558. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG nova.network.neutron [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updating instance_info_cache with network_info: [{"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:08:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-327e73a4-7d9b-4e05-b93c-f39258c16a90 req-cdfa0e25-e891-4dff-8b8f-73ac73275a17 service nova] Releasing lock "refresh_cache-4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:08:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:21 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:08:21 user nova-compute[73458]: INFO nova.compute.claims [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Claim successful on node user
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:08:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.policy [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5706f2b84a8148fea7e3c91808d39452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791d4bc10b648919b7ac2164c0b6709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.utils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:08:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Creating image(s)
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "/opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe8376-2c06-49b5-af06-ac02076237f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06441c8-c4ba-47bd-9068-40e568a125a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.162s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c34495-e778-4fa7-9a61-21bfb95e355a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1276e-ff0e-47ce-ad61-d088ceb00307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:08:22 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647ce91-c690-4f3a-b8bf-ddc8a1377ba1]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG os_brick.utils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (327ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updating existing volume attachment record: e82d5fd1-25cb-4152-94bb-6a68fe990393 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk 1073741824" returned: 0 in 0.062s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Successfully created port: e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.243s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:08:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Cannot resize image /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Ensure instance console log exists: /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Successfully updated port: e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquired lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-changed-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Refreshing instance network info cache due to event network-changed-e0251649-f874-4c82-ab15-4682c87c0df8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] Acquiring lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating instance_info_cache with network_info: [{"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Releasing lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Instance network_info: |[{"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] Acquired lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Refreshing network info cache for port e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Start _get_guest_xml network_info=[{"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:08:24 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:24 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-409510306',display_name='tempest-AttachVolumeNegativeTest-server-409510306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-409510306',id=36,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMKcc5N/ydUkBy4wyQRHzh4ulH7H7OOMQUdZemt9Jalyh4ybSFIlkm07FXtz6ATfdZzO1WNf6DHzTOfWkL+cI7umqQ7pbS5IkfTTgnjQXkgZoMeO2vxQ4TDRI8Yi3f/Pw==',key_name='tempest-keypair-82804632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-hicurx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=fea27c80-b879-4c84-993a-b1c8a1537534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.objects.instance [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'pci_devices' on Instance uuid fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:08:24 user nova-compute[73458]:   <uuid>fea27c80-b879-4c84-993a-b1c8a1537534</uuid>
Aug 27 01:08:24 user nova-compute[73458]:   <name>instance-00000024</name>
Aug 27 01:08:24 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:08:24 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:08:24 user nova-compute[73458]:   <metadata>
Aug 27 01:08:24 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:08:24 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeNegativeTest-server-409510306</nova:name>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:08:24</nova:creationTime>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:08:24 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:08:24 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:owner>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:user uuid="5706f2b84a8148fea7e3c91808d39452">tempest-AttachVolumeNegativeTest-643859675-project-member</nova:user>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:project uuid="b791d4bc10b648919b7ac2164c0b6709">tempest-AttachVolumeNegativeTest-643859675</nova:project>
Aug 27 01:08:24 user nova-compute[73458]:       </nova:owner>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:08:24 user nova-compute[73458]:       <nova:ports>
Aug 27 01:08:24 user nova-compute[73458]:         <nova:port uuid="e0251649-f874-4c82-ab15-4682c87c0df8">
Aug 27 01:08:24 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 01:08:24 user nova-compute[73458]:         </nova:port>
Aug 27 01:08:24 user nova-compute[73458]:       </nova:ports>
Aug 27 01:08:24 user nova-compute[73458]:     </nova:instance>
Aug 27 01:08:24 user nova-compute[73458]:   </metadata>
Aug 27 01:08:24 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:08:24 user nova-compute[73458]:     <system>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="serial">fea27c80-b879-4c84-993a-b1c8a1537534</entry>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="uuid">fea27c80-b879-4c84-993a-b1c8a1537534</entry>
Aug 27 01:08:24 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:08:24 user nova-compute[73458]:     </system>
Aug 27 01:08:24 user nova-compute[73458]:   </sysinfo>
Aug 27 01:08:24 user nova-compute[73458]:   <os>
Aug 27 01:08:24 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:08:24 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:08:24 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:08:24 user nova-compute[73458]:   </os>
Aug 27 01:08:24 user nova-compute[73458]:   <features>
Aug 27 01:08:24 user nova-compute[73458]:     <acpi/>
Aug 27 01:08:24 user nova-compute[73458]:     <apic/>
Aug 27 01:08:24 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:08:24 user nova-compute[73458]:   </features>
Aug 27 01:08:24 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:08:24 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:08:24 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:08:24 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:08:24 user nova-compute[73458]:   </clock>
Aug 27 01:08:24 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:08:24 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:08:24 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:08:24 user nova-compute[73458]:   </cpu>
Aug 27 01:08:24 user nova-compute[73458]:   <devices>
Aug 27 01:08:24 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:08:24 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:08:24 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk"/>
Aug 27 01:08:24 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:08:24 user nova-compute[73458]:     </disk>
Aug 27 01:08:24 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:08:24 user nova-compute[73458]:       <mac address="fa:16:3e:1c:02:a9"/>
Aug 27 01:08:24 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:08:24 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:08:24 user nova-compute[73458]:       <target dev="tape0251649-f8"/>
Aug 27 01:08:24 user nova-compute[73458]:     </interface>
Aug 27 01:08:24 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:08:24 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/console.log" append="off"/>
Aug 27 01:08:24 user nova-compute[73458]:     </serial>
Aug 27 01:08:24 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:08:24 user nova-compute[73458]:     <video>
Aug 27 01:08:24 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:08:24 user nova-compute[73458]:     </video>
Aug 27 01:08:24 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:08:24 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:08:24 user nova-compute[73458]:     </rng>
Aug 27 01:08:24 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:08:24 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:08:24 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:08:24 user nova-compute[73458]:     </memballoon>
Aug 27 01:08:24 user nova-compute[73458]:   </devices>
Aug 27 01:08:24 user nova-compute[73458]: </domain>
Aug 27 01:08:24 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-409510306',display_name='tempest-AttachVolumeNegativeTest-server-409510306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-409510306',id=36,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMKcc5N/ydUkBy4wyQRHzh4ulH7H7OOMQUdZemt9Jalyh4ybSFIlkm07FXtz6ATfdZzO1WNf6DHzTOfWkL+cI7umqQ7pbS5IkfTTgnjQXkgZoMeO2vxQ4TDRI8Yi3f/Pw==',key_name='tempest-keypair-82804632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-hicurx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:08:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=fea27c80-b879-4c84-993a-b1c8a1537534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG os_vif [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0251649-f8, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0251649-f8, col_values=(('external_ids', {'iface-id': 'e0251649-f874-4c82-ab15-4682c87c0df8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:02:a9', 'vm-uuid': 'fea27c80-b879-4c84-993a-b1c8a1537534'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:24 user nova-compute[73458]: INFO os_vif [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8')
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:1c:02:a9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updated VIF entry in instance network info cache for port e0251649-f874-4c82-ab15-4682c87c0df8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating instance_info_cache with network_info: [{"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:08:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2f0527cc-3521-4bbb-97ee-96581a870bb2 req-5377cb98-f765-4813-81d7-27aa4ca6a573 service nova] Releasing lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] No waiting events found dispatching network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:08:26 user nova-compute[73458]: WARNING nova.compute.manager [req-f9be8c19-8c36-496f-87ce-0cc05c61f641 req-decef3a6-ba6e-4b81-8910-effefed74f92 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received unexpected event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 for instance with vm_state building and task_state spawning.
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098508.1664956, fea27c80-b879-4c84-993a-b1c8a1537534 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] VM Resumed (Lifecycle Event)
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Instance spawned successfully.
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098508.1704433, fea27c80-b879-4c84-993a-b1c8a1537534 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] VM Started (Lifecycle Event)
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:08:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:28 user nova-compute[73458]: INFO nova.compute.manager [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Took 6.81 seconds to build instance.
Aug 27 01:08:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-711f1d39-b2a4-41fe-9a89-a7dbb301a187 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.898s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] No waiting events found dispatching network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:08:28 user nova-compute[73458]: WARNING nova.compute.manager [req-47d8b828-4cbd-4fa8-8664-e13655c831f3 req-f1ce7bd3-420b-43bd-a80d-95e0cc6f0dd7 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received unexpected event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 for instance with vm_state active and task_state None.
Aug 27 01:08:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:08:34 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Creating image(s)
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Ensure instance console log exists: /opt/stack/data/nova/instances/4c24cdb8-2be5-4b47-8bc9-90781f7e5b98/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Start _get_guest_xml network_info=[{"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgCQpcFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4c24cdb8-2be5-4b47-8bc9-90781f7e5b98', 'attached_at': '', 'detached_at': '', 'volume_id': '25a9a0b6-5faa-43c4-801e-dc4396563dcd', 'serial': '25a9a0b6-5faa-43c4-801e-dc4396563dcd'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'e82d5fd1-25cb-4152-94bb-6a68fe990393', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:08:34 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:34 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgCQpcFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:08:34 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:08:34 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:08:34 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6500e38-5076-4486-b043-65602645085d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:08:34 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87008ae7-e615-4ae0-b5e1-956253e46e8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd] added
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fc676a-5dd5-4ff8-ae95-7073a99a7756]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7663188b-3119-44ee-8408-3424adbfd5af]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgCQpcFy {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgCQpcFy" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd6559-f521-4c80-a42b-5b1172076b3d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgCQpcFy'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1219724b-8a90-49c4-9ed6-73ca369e0811]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992d5c5-b830-4fea-863f-75ee636db175]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c4b9b-9376-4af3-9d8a-9577c68fb775]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260]
Aug 27 01:08:34 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260] successful.
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42077f0-ca02-43b3-831a-dff5706d22a5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d23c1-4399-4600-bda1-1f221cd95b19]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:08:34 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:08:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba0163-8921-40cd-b8f2-88374f5e7ea0]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgCQpcFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26364303630386166', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303630386166', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1927694728',display_name='tempest-TestVolumeBootPattern-server-1927694728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1927694728',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-xkcwh50i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:08:17Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=4c24cdb8-2be5-4b47-8bc9-90781f7e5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:08:35 user nova-compute[73458]: DEBUG nova.objects.instance [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:08:36 user nova-compute[73458]:   <uuid>4c24cdb8-2be5-4b47-8bc9-90781f7e5b98</uuid>
Aug 27 01:08:36 user nova-compute[73458]:   <name>instance-00000023</name>
Aug 27 01:08:36 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:08:36 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:08:36 user nova-compute[73458]:   <metadata>
Aug 27 01:08:36 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:08:36 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:08:36 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-server-1927694728</nova:name>
Aug 27 01:08:36 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:08:34</nova:creationTime>
Aug 27 01:08:36 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:08:36 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:08:36 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:08:36 user nova-compute[73458]:       <nova:owner>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:08:36 user nova-compute[73458]:       </nova:owner>
Aug 27 01:08:36 user nova-compute[73458]:       <nova:ports>
Aug 27 01:08:36 user nova-compute[73458]:         <nova:port uuid="c8ff8c93-08a7-4ead-a04b-f9231ef10558">
Aug 27 01:08:36 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 01:08:36 user nova-compute[73458]:         </nova:port>
Aug 27 01:08:36 user nova-compute[73458]:       </nova:ports>
Aug 27 01:08:36 user nova-compute[73458]:     </nova:instance>
Aug 27 01:08:36 user nova-compute[73458]:   </metadata>
Aug 27 01:08:36 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:08:36 user nova-compute[73458]:     <system>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="serial">4c24cdb8-2be5-4b47-8bc9-90781f7e5b98</entry>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="uuid">4c24cdb8-2be5-4b47-8bc9-90781f7e5b98</entry>
Aug 27 01:08:36 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:08:36 user nova-compute[73458]:     </system>
Aug 27 01:08:36 user nova-compute[73458]:   </sysinfo>
Aug 27 01:08:36 user nova-compute[73458]:   <os>
Aug 27 01:08:36 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:08:36 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:08:36 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:08:36 user nova-compute[73458]:   </os>
Aug 27 01:08:36 user nova-compute[73458]:   <features>
Aug 27 01:08:36 user nova-compute[73458]:     <acpi/>
Aug 27 01:08:36 user nova-compute[73458]:     <apic/>
Aug 27 01:08:36 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:08:36 user nova-compute[73458]:   </features>
Aug 27 01:08:36 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:08:36 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:08:36 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:08:36 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:08:36 user nova-compute[73458]:   </clock>
Aug 27 01:08:36 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:08:36 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:08:36 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:08:36 user nova-compute[73458]:   </cpu>
Aug 27 01:08:36 user nova-compute[73458]:   <devices>
Aug 27 01:08:36 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:08:36 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:08:36 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:08:36 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:08:36 user nova-compute[73458]:       <serial>25a9a0b6-5faa-43c4-801e-dc4396563dcd</serial>
Aug 27 01:08:36 user nova-compute[73458]:     </disk>
Aug 27 01:08:36 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:08:36 user nova-compute[73458]:       <mac address="fa:16:3e:bc:78:2c"/>
Aug 27 01:08:36 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:08:36 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:08:36 user nova-compute[73458]:       <target dev="tapc8ff8c93-08"/>
Aug 27 01:08:36 user nova-compute[73458]:     </interface>
Aug 27 01:08:36 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:08:36 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4c24cdb8-2be5-4b47-8bc9-90781f7e5b98/console.log" append="off"/>
Aug 27 01:08:36 user nova-compute[73458]:     </serial>
Aug 27 01:08:36 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:08:36 user nova-compute[73458]:     <video>
Aug 27 01:08:36 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:08:36 user nova-compute[73458]:     </video>
Aug 27 01:08:36 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:08:36 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:08:36 user nova-compute[73458]:     </rng>
Aug 27 01:08:36 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:08:36 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:08:36 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:08:36 user nova-compute[73458]:     </memballoon>
Aug 27 01:08:36 user nova-compute[73458]:   </devices>
Aug 27 01:08:36 user nova-compute[73458]: </domain>
Aug 27 01:08:36 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1927694728',display_name='tempest-TestVolumeBootPattern-server-1927694728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1927694728',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-xkcwh50i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:08:17Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=4c24cdb8-2be5-4b47-8bc9-90781f7e5b98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG os_vif [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8ff8c93-08, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8ff8c93-08, col_values=(('external_ids', {'iface-id': 'c8ff8c93-08a7-4ead-a04b-f9231ef10558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:78:2c', 'vm-uuid': '4c24cdb8-2be5-4b47-8bc9-90781f7e5b98'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:36 user nova-compute[73458]: INFO os_vif [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08')
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:bc:78:2c, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] No waiting events found dispatching network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:08:37 user nova-compute[73458]: WARNING nova.compute.manager [req-583328e4-6ac5-4417-9350-4d588bd38f66 req-98144a50-1f1e-412c-a593-204529d51f6e service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received unexpected event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 for instance with vm_state building and task_state spawning.
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:08:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7228MB free_disk=24.980937957763672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fea27c80-b879-4c84-993a-b1c8a1537534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:08:38 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098519.553686, 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] VM Resumed (Lifecycle Event)
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Instance spawned successfully.
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098519.5560915, 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] VM Started (Lifecycle Event)
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] No waiting events found dispatching network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:08:39 user nova-compute[73458]: WARNING nova.compute.manager [req-5eb9cc13-4b1c-4b59-b4bd-9043af12fe21 req-252df1c6-a761-4176-865b-2c651e495c1b service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received unexpected event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 for instance with vm_state building and task_state spawning.
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 27 01:08:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:08:39 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:08:40 user nova-compute[73458]: INFO nova.compute.manager [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Took 24.23 seconds to build instance.
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-93d8cd54-a96f-4141-8f46-2d33d3713c0f tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.337s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [{"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-c4b43432-4735-496d-a9e9-79a264633d35" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:08:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:08:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'info_cache' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:08:59 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:00 user nova-compute[73458]: INFO nova.compute.manager [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Unrescuing
Aug 27 01:09:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:09:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquired lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:09:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance destroyed successfully.
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'resources' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG os_vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2862faca-10, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:09:01 user nova-compute[73458]: INFO os_vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start _get_guest_xml network_info=[{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'numa_topology' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:09:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [{"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Releasing lock "refresh_cache-8fa53972-0393-4835-8139-e03fa0a64f42" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'flavor' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:09:01 user nova-compute[73458]:   <uuid>64b863a7-f34f-4188-be01-4a89b1248368</uuid>
Aug 27 01:09:01 user nova-compute[73458]:   <name>instance-00000018</name>
Aug 27 01:09:01 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:09:01 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:09:01 user nova-compute[73458]:   <metadata>
Aug 27 01:09:01 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:09:01 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeTestJSON-server-827951787</nova:name>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:09:01</nova:creationTime>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:09:01 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:09:01 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:owner>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:user uuid="de7db48736b94edfa58071875ce52e65">tempest-AttachVolumeTestJSON-1240035283-project-member</nova:user>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:project uuid="621fecd1a05149b98beae4e5591b71e1">tempest-AttachVolumeTestJSON-1240035283</nova:project>
Aug 27 01:09:01 user nova-compute[73458]:       </nova:owner>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:09:01 user nova-compute[73458]:       <nova:ports>
Aug 27 01:09:01 user nova-compute[73458]:         <nova:port uuid="2862faca-1049-482c-9769-5980d4bbeef3">
Aug 27 01:09:01 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 01:09:01 user nova-compute[73458]:         </nova:port>
Aug 27 01:09:01 user nova-compute[73458]:       </nova:ports>
Aug 27 01:09:01 user nova-compute[73458]:     </nova:instance>
Aug 27 01:09:01 user nova-compute[73458]:   </metadata>
Aug 27 01:09:01 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:09:01 user nova-compute[73458]:     <system>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="serial">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="uuid">64b863a7-f34f-4188-be01-4a89b1248368</entry>
Aug 27 01:09:01 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:09:01 user nova-compute[73458]:     </system>
Aug 27 01:09:01 user nova-compute[73458]:   </sysinfo>
Aug 27 01:09:01 user nova-compute[73458]:   <os>
Aug 27 01:09:01 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:09:01 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:09:01 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:09:01 user nova-compute[73458]:   </os>
Aug 27 01:09:01 user nova-compute[73458]:   <features>
Aug 27 01:09:01 user nova-compute[73458]:     <acpi/>
Aug 27 01:09:01 user nova-compute[73458]:     <apic/>
Aug 27 01:09:01 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:09:01 user nova-compute[73458]:   </features>
Aug 27 01:09:01 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:09:01 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:09:01 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:09:01 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:09:01 user nova-compute[73458]:   </clock>
Aug 27 01:09:01 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:09:01 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:09:01 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:09:01 user nova-compute[73458]:   </cpu>
Aug 27 01:09:01 user nova-compute[73458]:   <devices>
Aug 27 01:09:01 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:09:01 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:09:01 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk"/>
Aug 27 01:09:01 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:09:01 user nova-compute[73458]:     </disk>
Aug 27 01:09:01 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:09:01 user nova-compute[73458]:       <mac address="fa:16:3e:29:54:c6"/>
Aug 27 01:09:01 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:09:01 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:09:01 user nova-compute[73458]:       <target dev="tap2862faca-10"/>
Aug 27 01:09:01 user nova-compute[73458]:     </interface>
Aug 27 01:09:01 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:09:01 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/console.log" append="off"/>
Aug 27 01:09:01 user nova-compute[73458]:     </serial>
Aug 27 01:09:01 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:09:01 user nova-compute[73458]:     <video>
Aug 27 01:09:01 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:09:01 user nova-compute[73458]:     </video>
Aug 27 01:09:01 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:09:01 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:09:01 user nova-compute[73458]:     </rng>
Aug 27 01:09:01 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:09:01 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:09:01 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:09:01 user nova-compute[73458]:     </memballoon>
Aug 27 01:09:01 user nova-compute[73458]:   </devices>
Aug 27 01:09:01 user nova-compute[73458]: </domain>
Aug 27 01:09:01 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:01 user nova-compute[73458]: WARNING nova.compute.manager [req-171be601-d5dc-4e87-afed-54617c50113c req-73eb8896-cf3d-4812-a441-16190bdd9431 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:09:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance destroyed successfully.
Aug 27 01:09:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Cannot resize image /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.objects.instance [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'migration_context' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.objects.base [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Object Instance<64b863a7-f34f-4188-be01-4a89b1248368> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG os_vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2862faca-10, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2862faca-10, col_values=(('external_ids', {'iface-id': '2862faca-1049-482c-9769-5980d4bbeef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:54:c6', 'vm-uuid': '64b863a7-f34f-4188-be01-4a89b1248368'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:09:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:02 user nova-compute[73458]: INFO os_vif [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:09:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:03 user nova-compute[73458]: WARNING nova.compute.manager [req-3e21c1d6-f8cf-4140-b188-70555d85d7c1 req-27bfd07c-0a93-4d19-9a33-0f1394f67915 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:05 user nova-compute[73458]: WARNING nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:05 user nova-compute[73458]: WARNING nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state rescued and task_state unrescuing.
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:05 user nova-compute[73458]: WARNING nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state powering-on.
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:09:05 user nova-compute[73458]: WARNING nova.compute.manager [req-230773ff-0866-498d-8391-0a518fd5a2c4 req-037c0535-1ec9-4989-95c0-4c3efde9231c service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state stopped and task_state powering-on.
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098547.1305761, 64b863a7-f34f-4188-be01-4a89b1248368 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Resumed (Lifecycle Event)
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance rebooted successfully.
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-71505f7f-200b-4f06-8693-f027b9fe3bf2 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098547.1326993, 64b863a7-f34f-4188-be01-4a89b1248368 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Started (Lifecycle Event)
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e32533b-6584-411b-b5dd-fb02ffe86a2f tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for 8fa53972-0393-4835-8139-e03fa0a64f42 due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098547.2229745, 8fa53972-0393-4835-8139-e03fa0a64f42 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Resumed (Lifecycle Event)
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098547.2231846, 8fa53972-0393-4835-8139-e03fa0a64f42 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:09:07 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Started (Lifecycle Event)
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:09:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:09:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing instance network info cache due to event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:09:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] Acquiring lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:09:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] Acquired lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:09:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updated VIF entry in instance network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating instance_info_cache with network_info: [{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-869ae54d-ff4c-49cc-bb18-c6c32d6b16be req-44f457d3-d234-46ab-91b1-5b672bcdc43b service nova] Releasing lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:16 user nova-compute[73458]: INFO nova.compute.manager [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Attaching volume 2fecea89-a972-4b15-b0b7-3c721a9e9c97 to /dev/vdb
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.utils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d53dee6-fc91-4434-9da0-af542a9a0913]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8330ee86-63fd-4970-ae56-668ab3f38007]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eba8ce-bfc0-45bd-a28a-16e76ad61f2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[33170055-29b8-4ef8-bf87-53633ec68667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:09:16 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:09:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105e21d-fe9b-4f80-88fd-cdad917defdf]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG os_brick.utils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:09:16 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating existing volume attachment record: b2d20273-bd61-4c85-9a1a-d3ee04a0f5f7 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:09:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:17 user nova-compute[73458]: INFO nova.compute.manager [None req-635cdfe0-3509-4b9e-b11f-c28e341bb165 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Get console output
Aug 27 01:09:17 user nova-compute[73458]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 27 01:09:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJTVwjfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:09:36 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:09:36 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:09:36 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[71172caf-16cb-4f18-a8fb-c00da7e11a09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:09:36 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ea735a-fc94-4316-83a0-cf207b1ae5be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97] added
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b49d5e-7e3b-487f-a723-11245caec4fe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7139bf7a-d673-4d10-922f-29b9d101d512]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJTVwjfE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CJTVwjfE" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe7cd5-4e32-4691-89c7-65e1a9361ac8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CJTVwjfE'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a634a60a-c3fe-426f-a4e2-0e59b315cbfb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ae57e7-9116-4e96-abc5-a83e2898467e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa8b0c9-9374-4223-b444-c3b39eb0aaa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260]
Aug 27 01:09:36 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260] successful.
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3350c8b6-9383-4458-93a4-4b371357fa87]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[81297e4b-dad7-4d2f-8b79-c9523cc10a5b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:36 user nova-compute[73458]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)
Aug 27 01:09:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ce5f49-3895-4b45-8dfd-22ad42b5490e]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJTVwjfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '26530636365306262', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530636365306262', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG nova.objects.instance [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:09:37 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:09:37 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:09:37 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:09:37 user nova-compute[73458]:   <serial>2fecea89-a972-4b15-b0b7-3c721a9e9c97</serial>
Aug 27 01:09:37 user nova-compute[73458]: </disk>
Aug 27 01:09:37 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] No VIF found with MAC fa:16:3e:c7:22:cd, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-695f726e-55ba-43a1-ac31-4e01b69ead07 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.875s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:09:40 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:09:40 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=6919MB free_disk=24.926589965820312GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:40 user nova-compute[73458]: INFO nova.compute.manager [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Detaching volume 2fecea89-a972-4b15-b0b7-3c721a9e9c97
Aug 27 01:09:40 user nova-compute[73458]: INFO nova.virt.block_device [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Attempting to driver detach volume 2fecea89-a972-4b15-b0b7-3c721a9e9c97 from mountpoint /dev/vdb
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Attempting to detach device vdb from instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:09:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:09:40 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:09:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:09:40 user nova-compute[73458]:   <serial>2fecea89-a972-4b15-b0b7-3c721a9e9c97</serial>
Aug 27 01:09:40 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:09:40 user nova-compute[73458]: </disk>
Aug 27 01:09:40 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:09:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully detached device vdb from instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff from the persistent domain config.
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:09:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:09:40 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:09:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:09:40 user nova-compute[73458]:   <serial>2fecea89-a972-4b15-b0b7-3c721a9e9c97</serial>
Aug 27 01:09:40 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:09:40 user nova-compute[73458]: </disk>
Aug 27 01:09:40 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fea27c80-b879-4c84-993a-b1c8a1537534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098580.9942627, c7a0f8c6-ff97-4f68-b2b1-5856373026ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:09:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:09:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully detached device vdb from instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff from the live domain config.
Aug 27 01:09:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CJTVwjfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:09:41 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a67b5eb-81f1-4335-a9ef-96075fb4f153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[53072d5c-c2ef-4b28-a6bc-4e2fdd0bb8e0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:41 user nova-compute[73458]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 (non-flash)
Aug 27 01:09:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786e9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4967bfb-f1f8-466e-9fe4-f76669731bca]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca51835a-5556-42f4-ae10-8bd04d794976]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d9c247-512b-4afa-a49e-21ceeb6b09eb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54268c-23d7-4e1f-9dc2-c1574652fa3f]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0166bec-64ef-4d48-84f8-1cc7c9779f13]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcb105-8ffe-404a-96f1-d4ed879247e0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260]
Aug 27 01:09:41 user nova-compute[73458]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97, portal: 172.16.0.220,3260] successful.
Aug 27 01:09:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fecea89-a972-4b15-b0b7-3c721a9e9c97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe7957-bb4d-47f8-9cce-5d82adf1ed4e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] <== disconnect_volume: return (306ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:09:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:09:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [{"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-85e602b0-6c12-4d09-825c-ececd08c663a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'flavor' on Instance uuid c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2e00b38d-219b-4e86-bc58-d3926367018b tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.331s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing instance network info cache due to event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updated VIF entry in instance network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:48 user nova-compute[73458]: INFO nova.compute.manager [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Detaching volume 5d4c51c9-1f63-4225-be53-53cb3ba9b88d
Aug 27 01:09:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1a32d673-55ef-4103-8d09-2ca3d8ce4365 req-59a72fa1-0fa6-4c75-85df-0ced8eaadd6a service nova] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:48 user nova-compute[73458]: INFO nova.virt.block_device [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Attempting to driver detach volume 5d4c51c9-1f63-4225-be53-53cb3ba9b88d from mountpoint /dev/vdb
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Attempting to detach device vdb from instance a8288776-acfb-4289-842e-d7c0139ee2ae from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:09:48 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:09:48 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 01:09:48 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:09:48 user nova-compute[73458]:   <serial>5d4c51c9-1f63-4225-be53-53cb3ba9b88d</serial>
Aug 27 01:09:48 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:09:48 user nova-compute[73458]: </disk>
Aug 27 01:09:48 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:09:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully detached device vdb from instance a8288776-acfb-4289-842e-d7c0139ee2ae from the persistent domain config.
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8288776-acfb-4289-842e-d7c0139ee2ae from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:09:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:09:48 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:09:48 user nova-compute[73458]:   <source dev="/dev/sdg"/>
Aug 27 01:09:48 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:09:48 user nova-compute[73458]:   <serial>5d4c51c9-1f63-4225-be53-53cb3ba9b88d</serial>
Aug 27 01:09:48 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:09:48 user nova-compute[73458]: </disk>
Aug 27 01:09:48 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098589.3524778, a8288776-acfb-4289-842e-d7c0139ee2ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:09:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully detached device vdb from instance a8288776-acfb-4289-842e-d7c0139ee2ae from the live domain config.
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wzFTohyn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:09:49 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a878c-9de3-41de-ad38-7515d6268365]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47bc0fb-2eb9-4adb-abb7-70b68ebaa1f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d (non-flash)
Aug 27 01:09:49 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:09:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e98298f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d'): ({'sdg'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Removing single pathed devices sdg {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7522c1b2-457b-4955-9bab-973688ebddb8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18b8d6-0cc5-4c84-af83-253f71ea0e15]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Flushing IO for device /dev/sdg {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c923aa4a-b8f1-4e8f-a4b8-54b83a45a7f4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf7e3cc-e273-47a0-aef5-d6b019ebbd30]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] SCSI volumes sdg have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb14f60-d252-4e10-8b52-b950543600da]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d8c6c-af9f-48bb-bb5d-579377ad7176]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260]
Aug 27 01:09:49 user nova-compute[73458]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d, portal: 172.16.0.220,3260] successful.
Aug 27 01:09:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d4c51c9-1f63-4225-be53-53cb3ba9b88d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1b33b-7a99-4e74-990a-bffcb83a1a52]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] <== disconnect_volume: return (326ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:09:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing instance network info cache due to event network-changed-b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] Acquiring lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] Acquired lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG nova.network.neutron [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Refreshing network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'flavor' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:09:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2d969114-5d8a-47d1-87db-521f32129ae4 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.743s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:09:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updated VIF entry in instance network info cache for port b1631295-d177-4f28-b28c-e9f333c0182e. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:09:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [{"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:09:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-723c397a-ae8f-4007-bdfa-ffdabc0815de req-e06e251a-df57-464a-88a9-7c3c43f0bf27 service nova] Releasing lock "refresh_cache-a8288776-acfb-4289-842e-d7c0139ee2ae" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:09:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:09:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:10:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:06 user nova-compute[73458]: INFO nova.compute.manager [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Terminating instance
Aug 27 01:10:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-unplugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] No waiting events found dispatching network-vif-unplugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-b32eee59-ab53-40a6-8ea8-88bce71673bd req-2944d619-f5e2-46d7-a657-d2ec80ab84cd service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-unplugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Instance destroyed successfully.
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1927694728',display_name='tempest-TestVolumeBootPattern-server-1927694728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1927694728',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-xkcwh50i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:08:40Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=4c24cdb8-2be5-4b47-8bc9-90781f7e5b98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "address": "fa:16:3e:bc:78:2c", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8ff8c93-08", "ovs_interfaceid": "c8ff8c93-08a7-4ead-a04b-f9231ef10558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_vif [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8ff8c93-08, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:07 user nova-compute[73458]: INFO os_vif [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:78:2c,bridge_name='br-int',has_traffic_filtering=True,id=c8ff8c93-08a7-4ead-a04b-f9231ef10558,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8ff8c93-08')
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgCQpcFy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa54e0-344f-46d6-8d9b-3db712da7561]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1503ac09-c83b-4c26-b01d-9e36504ae9ed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:10:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:10:07 user nova-compute[73458]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd (non-flash)
Aug 27 01:10:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e99278c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[950f2b1c-871b-464f-9efe-47ccf7f489e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b364768-0eb5-4232-801a-f12fc65412f3]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb71d306-49df-4726-a863-2240c92dcf22]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9f164-a649-4c17-826b-07cc302f09e5]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc7b0c6-0c06-4de7-b401-805422c765a4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883523d-23c7-4e3f-9760-1d1196818968]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260]
Aug 27 01:10:07 user nova-compute[73458]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd, portal: 172.16.0.220,3260] successful.
Aug 27 01:10:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25a9a0b6-5faa-43c4-801e-dc4396563dcd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d8b836-94dd-4f68-a22c-a1f1747a2797]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (326ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:10:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Deleting instance files /opt/stack/data/nova/instances/4c24cdb8-2be5-4b47-8bc9-90781f7e5b98_del
Aug 27 01:10:07 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Deletion of /opt/stack/data/nova/instances/4c24cdb8-2be5-4b47-8bc9-90781f7e5b98_del complete
Aug 27 01:10:07 user nova-compute[73458]: INFO nova.compute.manager [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:07 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:07 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:08 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:08 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Took 0.48 seconds to deallocate network for instance.
Aug 27 01:10:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c24f8a2-0815-45bc-8cbf-5d4e0ea30be8 req-347cc183-d518-43a8-9ff9-1c0a1977337d service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-deleted-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:08 user nova-compute[73458]: INFO nova.compute.manager [req-9c24f8a2-0815-45bc-8cbf-5d4e0ea30be8 req-347cc183-d518-43a8-9ff9-1c0a1977337d service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Neutron deleted interface c8ff8c93-08a7-4ead-a04b-f9231ef10558; detaching it from the instance and deleting it from the info cache
Aug 27 01:10:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-9c24f8a2-0815-45bc-8cbf-5d4e0ea30be8 req-347cc183-d518-43a8-9ff9-1c0a1977337d service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c24f8a2-0815-45bc-8cbf-5d4e0ea30be8 req-347cc183-d518-43a8-9ff9-1c0a1977337d service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Detach interface failed, port_id=c8ff8c93-08a7-4ead-a04b-f9231ef10558, reason: Instance 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] Acquiring lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] No waiting events found dispatching network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:09 user nova-compute[73458]: WARNING nova.compute.manager [req-fd25091c-c7f9-48be-976f-6e21fc438bd8 req-4daeae5b-2e88-4dfa-b3e1-ef5f7b483678 service nova] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Received unexpected event network-vif-plugged-c8ff8c93-08a7-4ead-a04b-f9231ef10558 for instance with vm_state active and task_state deleting.
Aug 27 01:10:09 user nova-compute[73458]: INFO nova.compute.manager [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Took 0.85 seconds to detach 1 volumes for instance.
Aug 27 01:10:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Deleting volume: 25a9a0b6-5faa-43c4-801e-dc4396563dcd {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:09 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98
Aug 27 01:10:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a6fbe41c-498d-4426-b1a0-8ef027eb9c7d tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "4c24cdb8-2be5-4b47-8bc9-90781f7e5b98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.329s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-changed-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG nova.compute.manager [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Refreshing instance network info cache due to event network-changed-e0251649-f874-4c82-ab15-4682c87c0df8. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] Acquiring lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] Acquired lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:10:12 user nova-compute[73458]: DEBUG nova.network.neutron [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Refreshing network info cache for port e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:10:13 user nova-compute[73458]: DEBUG nova.network.neutron [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updated VIF entry in instance network info cache for port e0251649-f874-4c82-ab15-4682c87c0df8. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:10:13 user nova-compute[73458]: DEBUG nova.network.neutron [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating instance_info_cache with network_info: [{"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2dff509a-0597-447f-a36a-842ef1356d17 req-b9ceb001-a918-4dd7-9bd5-c4974a0c6531 service nova] Releasing lock "refresh_cache-fea27c80-b879-4c84-993a-b1c8a1537534" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:10:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:17 user nova-compute[73458]: INFO nova.compute.manager [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Attaching volume 9de601ca-a2c9-4267-9309-7758d49f8479 to /dev/vdb
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.utils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e6da21-e4f9-4a6c-bcd3-29a4f58e84c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:18 user nova-compute[73458]: INFO nova.compute.manager [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Terminating instance
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ced24a-bcf6-40af-a9d7-b9945cd05e85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8c8c15-e7be-4542-8f0c-a7a41a0d978e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d119bf53-16d0-4686-8749-2ede5d0c569f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:10:18 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca92e8d-550d-40c5-a593-e2ef0031809d]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.utils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating existing volume attachment record: 82b85df4-c3a7-460e-9cc8-2120b2d51704 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-7a66bc50-66eb-4bd3-81d2-8c1641f76aae req-8d8c5125-ef55-4c07-b35e-1ee329aeeb58 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-unplugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Instance destroyed successfully.
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.objects.instance [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'resources' on Instance uuid 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-414505967',display_name='tempest-ServerActionsTestOtherA-server-414505967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-414505967',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-y7momwsu',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=27d4df7e-e2e2-4292-9a18-ae984b3be6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "address": "fa:16:3e:5b:50:fc", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d59c227-d9", "ovs_interfaceid": "0d59c227-d91a-4bac-ad34-26bb8498cb56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_vif [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d59c227-d9, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:18 user nova-compute[73458]: INFO os_vif [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:50:fc,bridge_name='br-int',has_traffic_filtering=True,id=0d59c227-d91a-4bac-ad34-26bb8498cb56,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d59c227-d9')
Aug 27 01:10:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TfOaEUBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:18 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f844588-efb0-4c07-95ad-0e906b66135c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08853f1-8734-4a00-b4d5-387c4614931d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 (non-flash)
Aug 27 01:10:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7837bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1800326-ab04-407b-91e9-6c1f6caa50e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79da2fa-c7a8-4d2f-adb1-1041e99e1126]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[044dc10d-eda7-454f-afb5-33f0923667a1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df73b4bd-f35b-4f42-8e31-5d2beac4885b]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8fe5c776', '/dev/disk/by-id/scsi-1SCST_BIO8fe5c776-4524572004a309c7', '/dev/disk/by-id/scsi-23435323435373230') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73b1534-c73f-4a3a-9db3-adba1e3b822e]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df181226-f650-4dc8-91d0-edd580784df2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63e85b-292e-410f-967d-9bfa87d22352]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260]
Aug 27 01:10:19 user nova-compute[73458]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550, portal: 172.16.0.220,3260] successful.
Aug 27 01:10:19 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c17661c-fd79-4eea-9d14-238851853550 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b7be82-aae8-4ece-9bab-c91d16a7d8a2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] <== disconnect_volume: return (322ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:10:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Deleting instance files /opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0_del
Aug 27 01:10:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Deletion of /opt/stack/data/nova/instances/27d4df7e-e2e2-4292-9a18-ae984b3be6a0_del complete
Aug 27 01:10:19 user nova-compute[73458]: INFO nova.compute.manager [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:19 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:20 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:20 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Took 0.99 seconds to deallocate network for instance.
Aug 27 01:10:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] Acquiring lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] No waiting events found dispatching network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:20 user nova-compute[73458]: WARNING nova.compute.manager [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received unexpected event network-vif-plugged-0d59c227-d91a-4bac-ad34-26bb8498cb56 for instance with vm_state active and task_state deleting.
Aug 27 01:10:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-9eaa8210-2e55-4b63-a93e-9c89fb9e0edf req-671153e0-178c-4b91-8b44-cdb9f25dd2e4 service nova] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Received event network-vif-deleted-0d59c227-d91a-4bac-ad34-26bb8498cb56 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:21 user nova-compute[73458]: INFO nova.compute.manager [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Took 0.80 seconds to detach 1 volumes for instance.
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Deleting volume: 5c17661c-fd79-4eea-9d14-238851853550 {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:21 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Deleted allocations for instance 27d4df7e-e2e2-4292-9a18-ae984b3be6a0
Aug 27 01:10:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-958252b3-8e79-4462-a9f5-8d7d2bbeeec3 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "27d4df7e-e2e2-4292-9a18-ae984b3be6a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.769s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:22 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098607.390102, 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:10:22 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] VM Stopped (Lifecycle Event)
Aug 27 01:10:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-58f32664-26bd-4f49-9762-d8e91aead553 None None] [instance: 4c24cdb8-2be5-4b47-8bc9-90781f7e5b98] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:10:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQKZoMqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:29 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:29 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:29 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a39154-c381-4564-b1e3-c37fe557f27b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:10:29 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cd6227-b85e-4df5-8bd8-4cca4b53a533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479] added
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34eb2e6-46b5-47c0-838b-9479de5d6ea1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cad3e6-0182-4f38-a469-7402ab5eb84a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQKZoMqy {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQKZoMqy" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7975e0-9863-4949-96cd-bd4e1b9e5017]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQKZoMqy'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f2e08-92ac-4ae9-8750-2670b154a15d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18638b-6324-45f3-95f0-3751d414075f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10be91e-4fd1-407c-a270-33ce6e90df8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260]
Aug 27 01:10:29 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260] successful.
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[191f7b61-7569-4ffc-ba06-5694843e04f8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e9d85-6c99-4356-bc84-9265f7364cfc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)
Aug 27 01:10:29 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:10:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe317f-5a9a-42c1-b88c-6fc5fe867c9f]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:10:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQKZoMqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26161623561636563', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161623561636563', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:10:31 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:10:31 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:10:31 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:10:31 user nova-compute[73458]:   <serial>9de601ca-a2c9-4267-9309-7758d49f8479</serial>
Aug 27 01:10:31 user nova-compute[73458]: </disk>
Aug 27 01:10:31 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing instance network info cache due to event network-changed-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] Acquiring lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] Acquired lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Refreshing network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:31 user nova-compute[73458]: INFO nova.compute.manager [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Terminating instance
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:1c:02:a9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6c4f5d9e-7e24-436a-842d-6413e48c50f1 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.673s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updated VIF entry in instance network info cache for port b1af10fa-4f63-4b8e-abd4-dc06951fbe4f. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating instance_info_cache with network_info: [{"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2485959b-d941-4e19-b81e-6ed86b57433b req-63563d3b-6dc0-46d4-aadf-ea758eb14043 service nova] Releasing lock "refresh_cache-c7a0f8c6-ff97-4f68-b2b1-5856373026ff" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Instance destroyed successfully.
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'resources' on Instance uuid c7a0f8c6-ff97-4f68-b2b1-5856373026ff {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1625098460',display_name='tempest-TestStampPattern-server-1625098460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1625098460',id=34,image_ref='e5a3ab87-ec9e-42ac-899c-88a6505ebd0c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:07:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-ide830ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f714a2a9-c211-4881-9555-97ab44333f9c',image_min_disk='1',image_min_ram='0',image_owner_id='19dbd4016f794fa180f1107d67f46e8a',image_owner_project_name='tempest-TestStampPattern-650683177',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-650683177-project-member',image_user_id='9c2d32f72d1b492a8547216dd6ab76ab',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:07:31Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=c7a0f8c6-ff97-4f68-b2b1-5856373026ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "address": "fa:16:3e:c7:22:cd", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1af10fa-4f", "ovs_interfaceid": "b1af10fa-4f63-4b8e-abd4-dc06951fbe4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_vif [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1af10fa-4f, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:32 user nova-compute[73458]: INFO os_vif [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:22:cd,bridge_name='br-int',has_traffic_filtering=True,id=b1af10fa-4f63-4b8e-abd4-dc06951fbe4f,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1af10fa-4f')
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Deleting instance files /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff_del
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Deletion of /opt/stack/data/nova/instances/c7a0f8c6-ff97-4f68-b2b1-5856373026ff_del complete
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.compute.manager [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.compute.manager [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Detaching volume 9de601ca-a2c9-4267-9309-7758d49f8479
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.block_device [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Attempting to driver detach volume 9de601ca-a2c9-4267-9309-7758d49f8479 from mountpoint /dev/vdb
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Attempting to detach device vdb from instance fea27c80-b879-4c84-993a-b1c8a1537534 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:10:32 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:10:32 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:10:32 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:10:32 user nova-compute[73458]:   <serial>9de601ca-a2c9-4267-9309-7758d49f8479</serial>
Aug 27 01:10:32 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:10:32 user nova-compute[73458]: </disk>
Aug 27 01:10:32 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance fea27c80-b879-4c84-993a-b1c8a1537534 from the persistent domain config.
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fea27c80-b879-4c84-993a-b1c8a1537534 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:10:32 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:10:32 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:10:32 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:10:32 user nova-compute[73458]:   <serial>9de601ca-a2c9-4267-9309-7758d49f8479</serial>
Aug 27 01:10:32 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:10:32 user nova-compute[73458]: </disk>
Aug 27 01:10:32 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Took 0.53 seconds to deallocate network for instance.
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098632.9093204, fea27c80-b879-4c84-993a-b1c8a1537534 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:10:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance fea27c80-b879-4c84-993a-b1c8a1537534 from the live domain config.
Aug 27 01:10:32 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQKZoMqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:32 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c13a303-355c-49a5-ac99-d417992fc26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca2449-dce5-4cc1-a35a-a25c4fd686ea]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 (non-flash)
Aug 27 01:10:32 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e99278c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:10:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[000c7c35-1c39-4f2f-8329-0d8743bca5d7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b423ff9c-3719-4881-a378-f558510a00d0]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[187d0050-a89c-4e9e-b52f-dd5f9de422e0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2801a-82d6-4965-a07a-badeeaa69cae]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc404a-9dc7-4044-9cd7-1a660ed9f775]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee821fdd-f9ff-4369-bfad-f9b8e06cfcb2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260]
Aug 27 01:10:33 user nova-compute[73458]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479, portal: 172.16.0.220,3260] successful.
Aug 27 01:10:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9de601ca-a2c9-4267-9309-7758d49f8479 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[091c07f2-9461-4e16-8b9b-ba9c0ecc4459]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== disconnect_volume: return (322ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-vif-unplugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] No waiting events found dispatching network-vif-unplugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:33 user nova-compute[73458]: WARNING nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received unexpected event network-vif-unplugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f for instance with vm_state deleted and task_state None.
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Acquiring lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] No waiting events found dispatching network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:33 user nova-compute[73458]: WARNING nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received unexpected event network-vif-plugged-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f for instance with vm_state deleted and task_state None.
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-e1250210-49ba-4cce-9538-dc5638aeb0ff req-869046be-15bc-458c-ac5c-97518073dcf3 service nova] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Received event network-vif-deleted-b1af10fa-4f63-4b8e-abd4-dc06951fbe4f {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:33 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Deleted allocations for instance c7a0f8c6-ff97-4f68-b2b1-5856373026ff
Aug 27 01:10:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fc4b8d07-89e4-44b7-be07-1e036b214efc tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "c7a0f8c6-ff97-4f68-b2b1-5856373026ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098618.8499959, 27d4df7e-e2e2-4292-9a18-ae984b3be6a0 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:10:33 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] VM Stopped (Lifecycle Event)
Aug 27 01:10:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-ec0bb9b0-799b-4018-be31-d42631307f96 None None] [instance: 27d4df7e-e2e2-4292-9a18-ae984b3be6a0] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:10:34 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0f2aefcf-12d5-484c-ad31-18f271570c5d tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:10:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:39 user nova-compute[73458]: INFO nova.compute.manager [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Terminating instance
Aug 27 01:10:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-0e97981a-d346-4e48-b6af-5d9e272e9917 req-5ad4e597-9781-41c0-9bf6-e98248156b19 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-unplugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Instance destroyed successfully.
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid a8288776-acfb-4289-842e-d7c0139ee2ae {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:03:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-334211179',display_name='tempest-ServerRescueNegativeTestJSON-server-334211179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-334211179',id=31,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXCLPNRahrwnC+gKnfZ5AmrvDDoFntWf7hmadnHLR08PWgzTreG/rfjr60+7V6AI8ycGWsaXQ0AnQmcn38mLtrgREkWf0GOxm60960OmjMyLJ9FX7NLtj1q2nVtwO/ECw==',key_name='tempest-keypair-1932288392',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:06:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-b51qnsl6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=a8288776-acfb-4289-842e-d7c0139ee2ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "b1631295-d177-4f28-b28c-e9f333c0182e", "address": "fa:16:3e:b0:48:1b", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1631295-d1", "ovs_interfaceid": "b1631295-d177-4f28-b28c-e9f333c0182e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG os_vif [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1631295-d1, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:40 user nova-compute[73458]: INFO os_vif [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:48:1b,bridge_name='br-int',has_traffic_filtering=True,id=b1631295-d177-4f28-b28c-e9f333c0182e,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1631295-d1')
Aug 27 01:10:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Deleting instance files /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae_del
Aug 27 01:10:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Deletion of /opt/stack/data/nova/instances/a8288776-acfb-4289-842e-d7c0139ee2ae_del complete
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:40 user nova-compute[73458]: INFO nova.compute.manager [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:10:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=24.924602508544922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fd76f35-50c9-4304-bad6-e72f01f03717 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 64b863a7-f34f-4188-be01-4a89b1248368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance a8288776-acfb-4289-842e-d7c0139ee2ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8fa53972-0393-4835-8139-e03fa0a64f42 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fea27c80-b879-4c84-993a-b1c8a1537534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:41 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Took 1.04 seconds to deallocate network for instance.
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-e0f10cf5-9d3b-4bf7-8d9a-8173651ee35f req-e7450d7c-fe21-4834-8899-330caeec1a77 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-deleted-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:41 user nova-compute[73458]: INFO nova.compute.manager [req-e0f10cf5-9d3b-4bf7-8d9a-8173651ee35f req-e7450d7c-fe21-4834-8899-330caeec1a77 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Neutron deleted interface b1631295-d177-4f28-b28c-e9f333c0182e; detaching it from the instance and deleting it from the info cache
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-e0f10cf5-9d3b-4bf7-8d9a-8173651ee35f req-e7450d7c-fe21-4834-8899-330caeec1a77 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-e0f10cf5-9d3b-4bf7-8d9a-8173651ee35f req-e7450d7c-fe21-4834-8899-330caeec1a77 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Detach interface failed, port_id=b1631295-d177-4f28-b28c-e9f333c0182e, reason: Instance a8288776-acfb-4289-842e-d7c0139ee2ae could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.269s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] Acquiring lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] No waiting events found dispatching network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:41 user nova-compute[73458]: WARNING nova.compute.manager [req-e10315d5-0658-4f28-b9f1-c6fa7771c092 req-ced537d4-ea35-4afe-a955-6529a50c1543 service nova] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Received unexpected event network-vif-plugged-b1631295-d177-4f28-b28c-e9f333c0182e for instance with vm_state deleted and task_state None.
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:42 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Deleted allocations for instance a8288776-acfb-4289-842e-d7c0139ee2ae
Aug 27 01:10:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c152e255-82de-464d-abec-cb4d29e8460b tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "a8288776-acfb-4289-842e-d7c0139ee2ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:10:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [{"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-64b863a7-f34f-4188-be01-4a89b1248368" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:10:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:10:47 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098632.206568, c7a0f8c6-ff97-4f68-b2b1-5856373026ff => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:10:47 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] VM Stopped (Lifecycle Event)
Aug 27 01:10:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d0fc2d7a-e0ff-49b8-86d5-d941581f13a9 None None] [instance: c7a0f8c6-ff97-4f68-b2b1-5856373026ff] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:10:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:51 user nova-compute[73458]: INFO nova.compute.manager [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Terminating instance
Aug 27 01:10:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:51 user nova-compute[73458]: INFO nova.compute.manager [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Terminating instance
Aug 27 01:10:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG nova.compute.manager [req-69ab496f-014f-49f3-89c8-b0f49c2b4702 req-a56a57a7-f631-4fbc-867d-237e43a537b6 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-unplugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Instance destroyed successfully.
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'resources' on Instance uuid 64b863a7-f34f-4188-be01-4a89b1248368 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Instance destroyed successfully.
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.objects.instance [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 8fa53972-0393-4835-8139-e03fa0a64f42 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:01:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-827951787',display_name='tempest-AttachVolumeTestJSON-server-827951787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-827951787',id=24,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDXLAdo+usrS2zpg3Fnbsz/4gUDIvukJrkpWVi5ycl1Q7BguGJ2gXpvmNsrL1y6stTGV1WYTTKUDgNMaQxfte/MsL+iqAIDpGJWAliQN56H5eliSlcnjLu53sQ645cEuw==',key_name='tempest-keypair-1470330795',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:01:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-s4yj6nxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=64b863a7-f34f-4188-be01-4a89b1248368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "2862faca-1049-482c-9769-5980d4bbeef3", "address": "fa:16:3e:29:54:c6", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2862faca-10", "ovs_interfaceid": "2862faca-1049-482c-9769-5980d4bbeef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_vif [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:05:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1908692436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1908692436',id=33,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:07:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-nx2zr64e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:09:07Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=8fa53972-0393-4835-8139-e03fa0a64f42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "address": "fa:16:3e:f1:40:15", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e4330f6-6a", "ovs_interfaceid": "8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_vif [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2862faca-10, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e4330f6-6a, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: INFO os_vif [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:54:c6,bridge_name='br-int',has_traffic_filtering=True,id=2862faca-1049-482c-9769-5980d4bbeef3,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2862faca-10')
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Deleting instance files /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368_del
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Deletion of /opt/stack/data/nova/instances/64b863a7-f34f-4188-be01-4a89b1248368_del complete
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:10:52 user nova-compute[73458]: INFO os_vif [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:40:15,bridge_name='br-int',has_traffic_filtering=True,id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e4330f6-6a')
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oLWycZQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:10:52 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db04e32e-1ce8-4925-94c6-3897c9f75a83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14ddaf-4e20-4ca2-b4a7-e5943960fd93]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:52 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:10:52 user nova-compute[73458]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 (non-flash)
Aug 27 01:10:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9031e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4'): ({'sdf'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Removing single pathed devices sdf {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.compute.manager [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6cb2e9-6545-471d-bbbd-a7d40dc288dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa2136d-57d3-4ea2-b3ca-b1062e5f664f]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flushing IO for device /dev/sdf {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[662b761e-072d-4d22-b874-96541cc70744]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f5d65-0a81-425b-a1a5-2a2f8abd5222]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] SCSI volumes sdf have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_978b9082', '/dev/disk/by-id/scsi-1SCST_BIO978b9082-4621f530ea95670e', '/dev/disk/by-id/scsi-23436323166353330') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e29466-93b0-4d10-8099-9a8b6638d0bc]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[855bc1f8-f663-43b4-9304-4a2a9fbef20e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa439c8-f7d1-4371-819e-a2692e449d0d]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260]
Aug 27 01:10:52 user nova-compute[73458]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4, portal: 172.16.0.220,3260] successful.
Aug 27 01:10:52 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a71c1667-6e9a-4998-ad28-75548ca012c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453da7c-50ab-481b-bbde-f4087e685559]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== disconnect_volume: return (319ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Deleting instance files /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42_del
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Deletion of /opt/stack/data/nova/instances/8fa53972-0393-4835-8139-e03fa0a64f42_del complete
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:52 user nova-compute[73458]: INFO nova.compute.manager [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 27 01:10:52 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:10:52 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:53 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Took 0.58 seconds to deallocate network for instance.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-79af5554-72da-4fde-9939-98ff47c55864 req-ae19702a-48bd-434c-8555-a0bdc1d2a6fb service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-deleted-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: INFO nova.compute.manager [req-79af5554-72da-4fde-9939-98ff47c55864 req-ae19702a-48bd-434c-8555-a0bdc1d2a6fb service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Neutron deleted interface 8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81; detaching it from the instance and deleting it from the info cache
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.network.neutron [req-79af5554-72da-4fde-9939-98ff47c55864 req-ae19702a-48bd-434c-8555-a0bdc1d2a6fb service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-79af5554-72da-4fde-9939-98ff47c55864 req-ae19702a-48bd-434c-8555-a0bdc1d2a6fb service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Detach interface failed, port_id=8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81, reason: Instance 8fa53972-0393-4835-8139-e03fa0a64f42 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "64b863a7-f34f-4188-be01-4a89b1248368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "64b863a7-f34f-4188-be01-4a89b1248368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] No waiting events found dispatching network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: WARNING nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received unexpected event network-vif-plugged-2862faca-1049-482c-9769-5980d4bbeef3 for instance with vm_state active and task_state deleting.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-unplugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: WARNING nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state deleting.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: WARNING nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state deleting.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: WARNING nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state deleting.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Acquiring lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] Lock "8fa53972-0393-4835-8139-e03fa0a64f42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] No waiting events found dispatching network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:10:53 user nova-compute[73458]: WARNING nova.compute.manager [req-7e09e91a-cf51-4569-ac4c-dbf000b8927d req-2d4b8f7a-0b90-4417-98d0-41dac9546790 service nova] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Received unexpected event network-vif-plugged-8e4330f6-6ae8-4ac4-a9d9-e68dc2e8af81 for instance with vm_state active and task_state deleting.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:10:53 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Took 1.22 seconds to deallocate network for instance.
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:54 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Deleted allocations for instance 64b863a7-f34f-4188-be01-4a89b1248368
Aug 27 01:10:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6946dd82-16d9-4181-bd25-0fda9127510c tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "64b863a7-f34f-4188-be01-4a89b1248368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:54 user nova-compute[73458]: INFO nova.compute.manager [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Took 0.85 seconds to detach 1 volumes for instance.
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:54 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Deleted allocations for instance 8fa53972-0393-4835-8139-e03fa0a64f42
Aug 27 01:10:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-61fa5af7-d439-4dac-86b8-87ee1c87d792 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "8fa53972-0393-4835-8139-e03fa0a64f42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.413s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:10:55 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098640.070893, a8288776-acfb-4289-842e-d7c0139ee2ae => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:10:55 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] VM Stopped (Lifecycle Event)
Aug 27 01:10:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e25d42ef-5eac-4491-8615-d49afd330415 None None] [instance: a8288776-acfb-4289-842e-d7c0139ee2ae] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:10:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-b2ef49d4-5b33-4b80-81d7-df78ab3d4b62 req-4d822ede-d259-4f46-981e-6841cce70fcf service nova] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Received event network-vif-deleted-2862faca-1049-482c-9769-5980d4bbeef3 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:10:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:07 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098652.4164171, 64b863a7-f34f-4188-be01-4a89b1248368 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:07 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] VM Stopped (Lifecycle Event)
Aug 27 01:11:07 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098652.4275303, 8fa53972-0393-4835-8139-e03fa0a64f42 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:07 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] VM Stopped (Lifecycle Event)
Aug 27 01:11:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-01b7f1f0-6d51-4e21-940e-898200f8c81e None None] [instance: 64b863a7-f34f-4188-be01-4a89b1248368] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9ac9721d-000c-4b1f-bcb9-8ddc9dbf8d5f None None] [instance: 8fa53972-0393-4835-8139-e03fa0a64f42] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:18 user nova-compute[73458]: INFO nova.compute.manager [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Terminating instance
Aug 27 01:11:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-unplugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] No waiting events found dispatching network-vif-unplugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-1522fa1b-1dce-4303-897f-4c25224488f8 req-0ed640c8-86a7-4621-b0bf-1271f561b500 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-unplugged-9414b9b8-e694-48da-9851-32597aba7fc2 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:11:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Instance destroyed successfully.
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.objects.instance [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lazy-loading 'resources' on Instance uuid 8fd76f35-50c9-4304-bad6-e72f01f03717 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-108582497',display_name='tempest-ServerActionsTestOtherA-server-108582497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-108582497',id=13,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAODcQheqFVlDR6Ky84O6mpqaS+NYpdiQNtWgcdkfifUTFJ+gJYmcG0TIBpTl4tmoprCtWGIb7jCMZELZQe8k+0PupLSSKNU3xjfVhICeMMorMok+e5bSvDnkyQw5eha7w==',key_name='tempest-keypair-84578088',keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:52:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd605e8ac6e749718ba402ae385a24bd',ramdisk_id='',reservation_id='r-krfyybzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1449025138',owner_user_name='tempest-ServerActionsTestOtherA-1449025138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15e8844b6f594cef9e904b88a6ca42b9',uuid=8fd76f35-50c9-4304-bad6-e72f01f03717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converting VIF {"id": "9414b9b8-e694-48da-9851-32597aba7fc2", "address": "fa:16:3e:04:c0:70", "network": {"id": "6946e91b-5930-4433-bb29-bb08f8a41b8d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1840300088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd605e8ac6e749718ba402ae385a24bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9414b9b8-e6", "ovs_interfaceid": "9414b9b8-e694-48da-9851-32597aba7fc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG os_vif [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9414b9b8-e6, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:19 user nova-compute[73458]: INFO os_vif [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c0:70,bridge_name='br-int',has_traffic_filtering=True,id=9414b9b8-e694-48da-9851-32597aba7fc2,network=Network(6946e91b-5930-4433-bb29-bb08f8a41b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9414b9b8-e6')
Aug 27 01:11:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Deleting instance files /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717_del
Aug 27 01:11:19 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Deletion of /opt/stack/data/nova/instances/8fd76f35-50c9-4304-bad6-e72f01f03717_del complete
Aug 27 01:11:19 user nova-compute[73458]: INFO nova.compute.manager [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 01:11:19 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:19 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Took 0.52 seconds to deallocate network for instance.
Aug 27 01:11:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:19 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:20 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Deleted allocations for instance 8fd76f35-50c9-4304-bad6-e72f01f03717
Aug 27 01:11:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bba95e38-cb06-4bda-8c33-74720b1359f9 tempest-ServerActionsTestOtherA-1449025138 tempest-ServerActionsTestOtherA-1449025138-project-member] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] Acquiring lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] Lock "8fd76f35-50c9-4304-bad6-e72f01f03717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] No waiting events found dispatching network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:20 user nova-compute[73458]: WARNING nova.compute.manager [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received unexpected event network-vif-plugged-9414b9b8-e694-48da-9851-32597aba7fc2 for instance with vm_state deleted and task_state None.
Aug 27 01:11:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-61e46d5c-5d80-4987-a5af-a796fda51fc6 req-b4a7ccc9-73d2-461d-b830-ba5400d37a95 service nova] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Received event network-vif-deleted-9414b9b8-e694-48da-9851-32597aba7fc2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:22 user nova-compute[73458]: INFO nova.compute.manager [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Terminating instance
Aug 27 01:11:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-unplugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] No waiting events found dispatching network-vif-unplugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-41e98ebc-5f72-45dc-a43f-721e2f232ce1 req-3456172c-1297-4ae5-b424-4def32d23077 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-unplugged-e0251649-f874-4c82-ab15-4682c87c0df8 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:11:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Instance destroyed successfully.
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'resources' on Instance uuid fea27c80-b879-4c84-993a-b1c8a1537534 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:08:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-409510306',display_name='tempest-AttachVolumeNegativeTest-server-409510306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-409510306',id=36,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMKcc5N/ydUkBy4wyQRHzh4ulH7H7OOMQUdZemt9Jalyh4ybSFIlkm07FXtz6ATfdZzO1WNf6DHzTOfWkL+cI7umqQ7pbS5IkfTTgnjQXkgZoMeO2vxQ4TDRI8Yi3f/Pw==',key_name='tempest-keypair-82804632',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:08:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-hicurx5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:08:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=fea27c80-b879-4c84-993a-b1c8a1537534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "e0251649-f874-4c82-ab15-4682c87c0df8", "address": "fa:16:3e:1c:02:a9", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0251649-f8", "ovs_interfaceid": "e0251649-f874-4c82-ab15-4682c87c0df8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG os_vif [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0251649-f8, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:23 user nova-compute[73458]: INFO os_vif [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:02:a9,bridge_name='br-int',has_traffic_filtering=True,id=e0251649-f874-4c82-ab15-4682c87c0df8,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0251649-f8')
Aug 27 01:11:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Deleting instance files /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534_del
Aug 27 01:11:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Deletion of /opt/stack/data/nova/instances/fea27c80-b879-4c84-993a-b1c8a1537534_del complete
Aug 27 01:11:23 user nova-compute[73458]: INFO nova.compute.manager [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 01:11:23 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:11:23 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:24 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Took 0.85 seconds to deallocate network for instance.
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-e4f716af-992d-463e-8883-1537d1a6c0db req-be82eea8-0104-4f6b-a5a9-d392637a57c9 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-deleted-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:24 user nova-compute[73458]: INFO nova.compute.manager [req-e4f716af-992d-463e-8883-1537d1a6c0db req-be82eea8-0104-4f6b-a5a9-d392637a57c9 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Neutron deleted interface e0251649-f874-4c82-ab15-4682c87c0df8; detaching it from the instance and deleting it from the info cache
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-e4f716af-992d-463e-8883-1537d1a6c0db req-be82eea8-0104-4f6b-a5a9-d392637a57c9 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-e4f716af-992d-463e-8883-1537d1a6c0db req-be82eea8-0104-4f6b-a5a9-d392637a57c9 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Detach interface failed, port_id=e0251649-f874-4c82-ab15-4682c87c0df8, reason: Instance fea27c80-b879-4c84-993a-b1c8a1537534 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:24 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Deleted allocations for instance fea27c80-b879-4c84-993a-b1c8a1537534
Aug 27 01:11:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4e05c2d5-f7f7-4b2a-9638-ba74b9b379ca tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "fea27c80-b879-4c84-993a-b1c8a1537534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] Acquiring lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] Lock "fea27c80-b879-4c84-993a-b1c8a1537534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] No waiting events found dispatching network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:25 user nova-compute[73458]: WARNING nova.compute.manager [req-a160886b-82c0-40e2-bbef-595bcf964145 req-fd4ab674-311d-4168-8d13-4998a746f715 service nova] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Received unexpected event network-vif-plugged-e0251649-f874-4c82-ab15-4682c87c0df8 for instance with vm_state deleted and task_state None.
Aug 27 01:11:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:11:32 user nova-compute[73458]: INFO nova.compute.claims [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Claim successful on node user
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:11:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:11:32 user nova-compute[73458]: DEBUG nova.policy [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:11:32 user nova-compute[73458]: INFO nova.virt.block_device [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Booting with volume acb4ae21-4712-47d2-8c17-a502f3aae6e0 at /dev/vda
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.utils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91e4313-0628-4293-a0a3-b0c7516ef290]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca74e98-3360-4b2f-bcf8-5466e926ef98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63997803-d061-4c9d-85ca-9e1f827c1a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23810c-b073-4758-ad13-7eacbf509ef6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:11:33 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dae422-23fa-465c-9e06-50d28bb13bab]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG os_brick.utils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating existing volume attachment record: 0d11c1a5-bef8-48b5-a79e-1073f54c2296 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Successfully created port: 687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098679.0610328, 8fd76f35-50c9-4304-bad6-e72f01f03717 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:34 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] VM Stopped (Lifecycle Event)
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-374b92de-9f9f-4c12-a13e-a93d6558ec5d None None] [instance: 8fd76f35-50c9-4304-bad6-e72f01f03717] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Successfully updated port: 687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-changed-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Refreshing instance network info cache due to event network-changed-687707d0-3599-4e1f-b18f-275cb30c6819. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] Acquiring lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating instance_info_cache with network_info: [{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Instance network_info: |[{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] Acquired lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Refreshing network info cache for port 687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:11:35 user nova-compute[73458]: DEBUG nova.network.neutron [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updated VIF entry in instance network info cache for port 687707d0-3599-4e1f-b18f-275cb30c6819. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:11:35 user nova-compute[73458]: DEBUG nova.network.neutron [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating instance_info_cache with network_info: [{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff6c7c0e-b397-4f87-ac38-0c882f13d78a req-696b292f-3de5-45d2-9515-95b73c455117 service nova] Releasing lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098683.4253452, fea27c80-b879-4c84-993a-b1c8a1537534 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:38 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] VM Stopped (Lifecycle Event)
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f59648e6-33a9-4422-b773-54068d3e8206 None None] [instance: fea27c80-b879-4c84-993a-b1c8a1537534] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:40 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:40 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8093MB free_disk=25.033302307128906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance c4b43432-4735-496d-a9e9-79a264633d35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 85e602b0-6c12-4d09-825c-ececd08c663a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 251d68d6-f239-4bcd-844a-cd0833a09d0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance f714a2a9-c211-4881-9555-97ab44333f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 97832e51-8a29-4073-b61e-e2aa479e58c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:11:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:42 user nova-compute[73458]: INFO nova.compute.manager [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Terminating instance
Aug 27 01:11:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-unplugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] No waiting events found dispatching network-vif-unplugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9a0c103-d6b4-4c31-a67e-82e2351d1bba req-782d565f-df16-451b-997d-6dd5e4163b38 service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-unplugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:11:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance destroyed successfully.
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 251d68d6-f239-4bcd-844a-cd0833a09d0e {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1737038114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1737038114',id=27,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:02:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-dvnozewq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:04:16Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=251d68d6-f239-4bcd-844a-cd0833a09d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "address": "fa:16:3e:5c:83:81", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb640dcd-c8", "ovs_interfaceid": "bb640dcd-c880-4c6e-89ff-06f5a6d75b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG os_vif [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb640dcd-c8, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:43 user nova-compute[73458]: INFO os_vif [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:83:81,bridge_name='br-int',has_traffic_filtering=True,id=bb640dcd-c880-4c6e-89ff-06f5a6d75b09,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb640dcd-c8')
Aug 27 01:11:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Deleting instance files /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e_del
Aug 27 01:11:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Deletion of /opt/stack/data/nova/instances/251d68d6-f239-4bcd-844a-cd0833a09d0e_del complete
Aug 27 01:11:43 user nova-compute[73458]: INFO nova.compute.manager [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 01:11:43 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:11:43 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:43 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Took 0.57 seconds to deallocate network for instance.
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:44 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Deleted allocations for instance 251d68d6-f239-4bcd-844a-cd0833a09d0e
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b04eb188-69b5-4f82-aa34-d1608711e502 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-251d68d6-f239-4bcd-844a-cd0833a09d0e" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:11:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Creating image(s)
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Ensure instance console log exists: /opt/stack/data/nova/instances/97832e51-8a29-4073-b61e-e2aa479e58c6/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Start _get_guest_xml network_info=[{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXDTgboW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97832e51-8a29-4073-b61e-e2aa479e58c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'acb4ae21-4712-47d2-8c17-a502f3aae6e0', 'serial': 'acb4ae21-4712-47d2-8c17-a502f3aae6e0'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '0d11c1a5-bef8-48b5-a79e-1073f54c2296', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:11:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXDTgboW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:11:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:11:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:11:44 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5540042-33ba-4087-9c4a-f9705bc33e79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:11:44 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5deb9-c13a-46e9-bd3b-bb425fa28ad8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0] added
Aug 27 01:11:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ad3ec-15d8-4d01-aa97-9453eddc4d47]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[288a587c-552b-4eda-8794-3b7cff3627bf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXDTgboW {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXDTgboW" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86ea72c-f357-4bfa-9348-a55ae3df3445]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZXDTgboW'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c2ef8-f692-4033-be83-05b5012cceb4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efd186f-af9c-49cf-bc7d-da864b678663]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:11:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:11:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:11:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bcef8a-8997-4ebc-8ffa-4fc3dddbfd6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260]
Aug 27 01:11:45 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260] successful.
Aug 27 01:11:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0de8f2-cc65-4d5d-a8bf-d2555c2e7a1d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef88fd9a-c092-4d17-9bba-b3bed6c8bdb9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:11:45 user nova-compute[73458]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:11:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:11:45 user nova-compute[73458]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:11:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfdfd72-9a72-4ff9-bcf4-b37695ea92d4]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] Acquiring lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] Lock "251d68d6-f239-4bcd-844a-cd0833a09d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] No waiting events found dispatching network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:45 user nova-compute[73458]: WARNING nova.compute.manager [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received unexpected event network-vif-plugged-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 for instance with vm_state deleted and task_state None.
Aug 27 01:11:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-b793b5bd-7cc7-47ad-ad7b-155e032b3153 req-0c6e2a96-cce6-4881-8740-177e1af895db service nova] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Received event network-vif-deleted-bb640dcd-c880-4c6e-89ff-06f5a6d75b09 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXDTgboW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23166373938623061', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166373938623061', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1852700526',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyn46HviSImPCN8HS/NvXHKiTpZ4ZpD7xP8htun+6yxPi7coft5+bCKqZfKAZbTPcPl7686dG7LrvGXOB50kbcqa2xxK9/F0l44NI0GiaDSmKoCO4iAw6yzKzZQaDIWdw==',key_name='tempest-keypair-146345837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-df0xwzu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=97832e51-8a29-4073-b61e-e2aa479e58c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid 97832e51-8a29-4073-b61e-e2aa479e58c6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:11:46 user nova-compute[73458]:   <uuid>97832e51-8a29-4073-b61e-e2aa479e58c6</uuid>
Aug 27 01:11:46 user nova-compute[73458]:   <name>instance-00000025</name>
Aug 27 01:11:46 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:11:46 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:11:46 user nova-compute[73458]:   <metadata>
Aug 27 01:11:46 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:11:46 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:11:46 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1852700526</nova:name>
Aug 27 01:11:46 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:11:44</nova:creationTime>
Aug 27 01:11:46 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:11:46 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:11:46 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:11:46 user nova-compute[73458]:       <nova:owner>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:11:46 user nova-compute[73458]:       </nova:owner>
Aug 27 01:11:46 user nova-compute[73458]:       <nova:ports>
Aug 27 01:11:46 user nova-compute[73458]:         <nova:port uuid="687707d0-3599-4e1f-b18f-275cb30c6819">
Aug 27 01:11:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 01:11:46 user nova-compute[73458]:         </nova:port>
Aug 27 01:11:46 user nova-compute[73458]:       </nova:ports>
Aug 27 01:11:46 user nova-compute[73458]:     </nova:instance>
Aug 27 01:11:46 user nova-compute[73458]:   </metadata>
Aug 27 01:11:46 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:11:46 user nova-compute[73458]:     <system>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="serial">97832e51-8a29-4073-b61e-e2aa479e58c6</entry>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="uuid">97832e51-8a29-4073-b61e-e2aa479e58c6</entry>
Aug 27 01:11:46 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:11:46 user nova-compute[73458]:     </system>
Aug 27 01:11:46 user nova-compute[73458]:   </sysinfo>
Aug 27 01:11:46 user nova-compute[73458]:   <os>
Aug 27 01:11:46 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:11:46 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:11:46 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:11:46 user nova-compute[73458]:   </os>
Aug 27 01:11:46 user nova-compute[73458]:   <features>
Aug 27 01:11:46 user nova-compute[73458]:     <acpi/>
Aug 27 01:11:46 user nova-compute[73458]:     <apic/>
Aug 27 01:11:46 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:11:46 user nova-compute[73458]:   </features>
Aug 27 01:11:46 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:11:46 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:11:46 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:11:46 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:11:46 user nova-compute[73458]:   </clock>
Aug 27 01:11:46 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:11:46 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:11:46 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:11:46 user nova-compute[73458]:   </cpu>
Aug 27 01:11:46 user nova-compute[73458]:   <devices>
Aug 27 01:11:46 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:11:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:11:46 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:11:46 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:11:46 user nova-compute[73458]:       <serial>acb4ae21-4712-47d2-8c17-a502f3aae6e0</serial>
Aug 27 01:11:46 user nova-compute[73458]:     </disk>
Aug 27 01:11:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:11:46 user nova-compute[73458]:       <mac address="fa:16:3e:ea:9e:87"/>
Aug 27 01:11:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:11:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:11:46 user nova-compute[73458]:       <target dev="tap687707d0-35"/>
Aug 27 01:11:46 user nova-compute[73458]:     </interface>
Aug 27 01:11:46 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:11:46 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/97832e51-8a29-4073-b61e-e2aa479e58c6/console.log" append="off"/>
Aug 27 01:11:46 user nova-compute[73458]:     </serial>
Aug 27 01:11:46 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:11:46 user nova-compute[73458]:     <video>
Aug 27 01:11:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:11:46 user nova-compute[73458]:     </video>
Aug 27 01:11:46 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:11:46 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:11:46 user nova-compute[73458]:     </rng>
Aug 27 01:11:46 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:11:46 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:11:46 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:11:46 user nova-compute[73458]:     </memballoon>
Aug 27 01:11:46 user nova-compute[73458]:   </devices>
Aug 27 01:11:46 user nova-compute[73458]: </domain>
Aug 27 01:11:46 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1852700526',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyn46HviSImPCN8HS/NvXHKiTpZ4ZpD7xP8htun+6yxPi7coft5+bCKqZfKAZbTPcPl7686dG7LrvGXOB50kbcqa2xxK9/F0l44NI0GiaDSmKoCO4iAw6yzKzZQaDIWdw==',key_name='tempest-keypair-146345837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-df0xwzu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=97832e51-8a29-4073-b61e-e2aa479e58c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG os_vif [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap687707d0-35, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap687707d0-35, col_values=(('external_ids', {'iface-id': '687707d0-3599-4e1f-b18f-275cb30c6819', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:9e:87', 'vm-uuid': '97832e51-8a29-4073-b61e-e2aa479e58c6'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:46 user nova-compute[73458]: INFO os_vif [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35')
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:11:46 user nova-compute[73458]: INFO nova.compute.claims [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Claim successful on node user
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:ea:9e:87, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing instance network info cache due to event network-changed-2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] Acquiring lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] Acquired lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.neutron [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Refreshing network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:11:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:46 user nova-compute[73458]: INFO nova.compute.manager [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Terminating instance
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.policy [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de7db48736b94edfa58071875ce52e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621fecd1a05149b98beae4e5591b71e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:11:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Creating image(s)
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "/opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "/opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updated VIF entry in instance network info cache for port 2ea0718a-6084-420b-9e97-482bbde38ea0. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.network.neutron [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [{"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk 1073741824" returned: 0 in 0.056s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fc78abd6-2148-4ce4-94d2-9669f8ce33a7 req-ab90b9e7-0d15-406d-a240-84f613e376a5 service nova] Releasing lock "refresh_cache-f714a2a9-c211-4881-9555-97ab44333f9c" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Cannot resize image /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Ensure instance console log exists: /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Instance destroyed successfully.
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lazy-loading 'resources' on Instance uuid f714a2a9-c211-4881-9555-97ab44333f9c {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1209945458',display_name='tempest-TestStampPattern-server-1209945458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1209945458',id=32,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2mSEPspGUK6M5bWSBhpzWN2FPxQMx+A05r6JPcSQRXfjZCLX+ubVqIJgXNj//b59U6W/noRl4bdHl3YTZ2VhL+MhAcq1xPvGH3QL+a3II2fJ7kHid0L3osQ4ucychDow==',key_name='tempest-TestStampPattern-1110793064',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19dbd4016f794fa180f1107d67f46e8a',ramdisk_id='',reservation_id='r-q6i7xjfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-650683177',owner_user_name='tempest-TestStampPattern-650683177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:07:21Z,user_data=None,user_id='9c2d32f72d1b492a8547216dd6ab76ab',uuid=f714a2a9-c211-4881-9555-97ab44333f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converting VIF {"id": "2ea0718a-6084-420b-9e97-482bbde38ea0", "address": "fa:16:3e:01:76:b9", "network": {"id": "2974ca5f-208e-4e1d-aaf4-1999a21bc405", "bridge": "br-int", "label": "tempest-TestStampPattern-817526814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19dbd4016f794fa180f1107d67f46e8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea0718a-60", "ovs_interfaceid": "2ea0718a-6084-420b-9e97-482bbde38ea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG os_vif [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea0718a-60, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:47 user nova-compute[73458]: INFO os_vif [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:b9,bridge_name='br-int',has_traffic_filtering=True,id=2ea0718a-6084-420b-9e97-482bbde38ea0,network=Network(2974ca5f-208e-4e1d-aaf4-1999a21bc405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea0718a-60')
Aug 27 01:11:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Deleting instance files /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c_del
Aug 27 01:11:48 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Deletion of /opt/stack/data/nova/instances/f714a2a9-c211-4881-9555-97ab44333f9c_del complete
Aug 27 01:11:48 user nova-compute[73458]: INFO nova.compute.manager [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] No waiting events found dispatching network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:48 user nova-compute[73458]: WARNING nova.compute.manager [req-2a1af355-c9fd-4d07-9635-fae508012cd9 req-4ca434fc-0317-4c18-b472-f5f10fecb82c service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received unexpected event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 for instance with vm_state building and task_state spawning.
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Successfully created port: fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:48 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Took 0.66 seconds to deallocate network for instance.
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-bd56e23b-cae0-44f5-93b1-4204bdd5a2b6 req-a97413fd-a382-41b8-832b-359ea698f492 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-deleted-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:48 user nova-compute[73458]: INFO nova.compute.manager [req-bd56e23b-cae0-44f5-93b1-4204bdd5a2b6 req-a97413fd-a382-41b8-832b-359ea698f492 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Neutron deleted interface 2ea0718a-6084-420b-9e97-482bbde38ea0; detaching it from the instance and deleting it from the info cache
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-bd56e23b-cae0-44f5-93b1-4204bdd5a2b6 req-a97413fd-a382-41b8-832b-359ea698f492 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-bd56e23b-cae0-44f5-93b1-4204bdd5a2b6 req-a97413fd-a382-41b8-832b-359ea698f492 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Detach interface failed, port_id=2ea0718a-6084-420b-9e97-482bbde38ea0, reason: Instance f714a2a9-c211-4881-9555-97ab44333f9c could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-unplugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] No waiting events found dispatching network-vif-unplugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-unplugged-2ea0718a-6084-420b-9e97-482bbde38ea0 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Acquiring lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] Lock "f714a2a9-c211-4881-9555-97ab44333f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] No waiting events found dispatching network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:48 user nova-compute[73458]: WARNING nova.compute.manager [req-8dbd2ce3-e440-4753-8b24-8697767a42fc req-bbd44cb2-47af-413d-83e8-2a5a9839c723 service nova] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Received unexpected event network-vif-plugged-2ea0718a-6084-420b-9e97-482bbde38ea0 for instance with vm_state active and task_state deleting.
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:49 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Deleted allocations for instance f714a2a9-c211-4881-9555-97ab44333f9c
Aug 27 01:11:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8c3ce82d-360d-40c1-b0fd-0294b58fc624 tempest-TestStampPattern-650683177 tempest-TestStampPattern-650683177-project-member] Lock "f714a2a9-c211-4881-9555-97ab44333f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.382s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Successfully updated port: fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquired lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating instance_info_cache with network_info: [{"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Releasing lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Instance network_info: |[{"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Start _get_guest_xml network_info=[{"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:11:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960009725',display_name='tempest-AttachVolumeTestJSON-server-960009725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-960009725',id=38,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBVeZc3qK4o/DBo0lWvTbW3aHR+eoR/fuqqR0ERjtLfcjfbKXgNi0HyV4ZTrkipEd7l0lkqczH2a+k0j7AzTy8dNqRFZh3+LqVsTHcsxWN82g4pb8yfZudxn6zneJCHgg==',key_name='tempest-keypair-1819702105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-mpew16ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=4b3de184-3578-4f0a-8433-9e7e1f5625f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.objects.instance [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:11:49 user nova-compute[73458]:   <uuid>4b3de184-3578-4f0a-8433-9e7e1f5625f8</uuid>
Aug 27 01:11:49 user nova-compute[73458]:   <name>instance-00000026</name>
Aug 27 01:11:49 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:11:49 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:11:49 user nova-compute[73458]:   <metadata>
Aug 27 01:11:49 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:11:49 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeTestJSON-server-960009725</nova:name>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:11:49</nova:creationTime>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:11:49 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:11:49 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:owner>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:user uuid="de7db48736b94edfa58071875ce52e65">tempest-AttachVolumeTestJSON-1240035283-project-member</nova:user>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:project uuid="621fecd1a05149b98beae4e5591b71e1">tempest-AttachVolumeTestJSON-1240035283</nova:project>
Aug 27 01:11:49 user nova-compute[73458]:       </nova:owner>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:11:49 user nova-compute[73458]:       <nova:ports>
Aug 27 01:11:49 user nova-compute[73458]:         <nova:port uuid="fedfe353-6b96-4dbc-971b-8a966068a4e2">
Aug 27 01:11:49 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 01:11:49 user nova-compute[73458]:         </nova:port>
Aug 27 01:11:49 user nova-compute[73458]:       </nova:ports>
Aug 27 01:11:49 user nova-compute[73458]:     </nova:instance>
Aug 27 01:11:49 user nova-compute[73458]:   </metadata>
Aug 27 01:11:49 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:11:49 user nova-compute[73458]:     <system>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="serial">4b3de184-3578-4f0a-8433-9e7e1f5625f8</entry>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="uuid">4b3de184-3578-4f0a-8433-9e7e1f5625f8</entry>
Aug 27 01:11:49 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:11:49 user nova-compute[73458]:     </system>
Aug 27 01:11:49 user nova-compute[73458]:   </sysinfo>
Aug 27 01:11:49 user nova-compute[73458]:   <os>
Aug 27 01:11:49 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:11:49 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:11:49 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:11:49 user nova-compute[73458]:   </os>
Aug 27 01:11:49 user nova-compute[73458]:   <features>
Aug 27 01:11:49 user nova-compute[73458]:     <acpi/>
Aug 27 01:11:49 user nova-compute[73458]:     <apic/>
Aug 27 01:11:49 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:11:49 user nova-compute[73458]:   </features>
Aug 27 01:11:49 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:11:49 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:11:49 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:11:49 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:11:49 user nova-compute[73458]:   </clock>
Aug 27 01:11:49 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:11:49 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:11:49 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:11:49 user nova-compute[73458]:   </cpu>
Aug 27 01:11:49 user nova-compute[73458]:   <devices>
Aug 27 01:11:49 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:11:49 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:11:49 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk"/>
Aug 27 01:11:49 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:11:49 user nova-compute[73458]:     </disk>
Aug 27 01:11:49 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:11:49 user nova-compute[73458]:       <mac address="fa:16:3e:96:e0:f9"/>
Aug 27 01:11:49 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:11:49 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:11:49 user nova-compute[73458]:       <target dev="tapfedfe353-6b"/>
Aug 27 01:11:49 user nova-compute[73458]:     </interface>
Aug 27 01:11:49 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:11:49 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/console.log" append="off"/>
Aug 27 01:11:49 user nova-compute[73458]:     </serial>
Aug 27 01:11:49 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:11:49 user nova-compute[73458]:     <video>
Aug 27 01:11:49 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:11:49 user nova-compute[73458]:     </video>
Aug 27 01:11:49 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:11:49 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:11:49 user nova-compute[73458]:     </rng>
Aug 27 01:11:49 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:11:49 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:11:49 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:11:49 user nova-compute[73458]:     </memballoon>
Aug 27 01:11:49 user nova-compute[73458]:   </devices>
Aug 27 01:11:49 user nova-compute[73458]: </domain>
Aug 27 01:11:49 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960009725',display_name='tempest-AttachVolumeTestJSON-server-960009725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-960009725',id=38,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBVeZc3qK4o/DBo0lWvTbW3aHR+eoR/fuqqR0ERjtLfcjfbKXgNi0HyV4ZTrkipEd7l0lkqczH2a+k0j7AzTy8dNqRFZh3+LqVsTHcsxWN82g4pb8yfZudxn6zneJCHgg==',key_name='tempest-keypair-1819702105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-mpew16ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:11:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=4b3de184-3578-4f0a-8433-9e7e1f5625f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG os_vif [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfedfe353-6b, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfedfe353-6b, col_values=(('external_ids', {'iface-id': 'fedfe353-6b96-4dbc-971b-8a966068a4e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e0:f9', 'vm-uuid': '4b3de184-3578-4f0a-8433-9e7e1f5625f8'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:49 user nova-compute[73458]: INFO os_vif [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b')
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:11:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No VIF found with MAC fa:16:3e:96:e0:f9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098710.1921196, 97832e51-8a29-4073-b61e-e2aa479e58c6 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] VM Resumed (Lifecycle Event)
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Instance spawned successfully.
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098710.1933594, 97832e51-8a29-4073-b61e-e2aa479e58c6 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] VM Started (Lifecycle Event)
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] No waiting events found dispatching network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:50 user nova-compute[73458]: WARNING nova.compute.manager [req-0fa2ecc3-5032-4435-b127-4635374fe96a req-97bbafab-d752-49a6-a1b6-69c378b515d4 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received unexpected event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 for instance with vm_state building and task_state spawning.
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:50 user nova-compute[73458]: INFO nova.compute.manager [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Took 18.05 seconds to build instance.
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-1792cf31-927d-4068-8509-4a1e086cb614 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.182s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-changed-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Refreshing instance network info cache due to event network-changed-fedfe353-6b96-4dbc-971b-8a966068a4e2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] Acquiring lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] Acquired lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:11:50 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Refreshing network info cache for port fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updated VIF entry in instance network info cache for port fedfe353-6b96-4dbc-971b-8a966068a4e2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating instance_info_cache with network_info: [{"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb6e14e6-5573-403b-833b-db0aa10427db req-5ee42788-c81f-4f6a-9662-699fa464b9bd service nova] Releasing lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:11:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] No waiting events found dispatching network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:52 user nova-compute[73458]: WARNING nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received unexpected event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 for instance with vm_state building and task_state spawning.
Aug 27 01:11:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] No waiting events found dispatching network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:11:52 user nova-compute[73458]: WARNING nova.compute.manager [req-0c040fe7-05cd-42ee-b9cf-7aafd2425c3f req-b8be5b3c-a686-4a11-b8b1-6fef495f9974 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received unexpected event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 for instance with vm_state building and task_state spawning.
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098713.7750037, 4b3de184-3578-4f0a-8433-9e7e1f5625f8 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] VM Resumed (Lifecycle Event)
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Instance spawned successfully.
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098713.7784483, 4b3de184-3578-4f0a-8433-9e7e1f5625f8 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] VM Started (Lifecycle Event)
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:11:53 user nova-compute[73458]: INFO nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 27 01:11:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:54 user nova-compute[73458]: INFO nova.compute.manager [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Took 7.77 seconds to build instance.
Aug 27 01:11:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14d3c125-71b0-4dd1-813f-f0ccbf386bf6 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.897s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:11:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:58 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098703.2496684, 251d68d6-f239-4bcd-844a-cd0833a09d0e => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:11:58 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] VM Stopped (Lifecycle Event)
Aug 27 01:11:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-caba45c2-2b7a-4676-863d-4a2599d6b583 None None] [instance: 251d68d6-f239-4bcd-844a-cd0833a09d0e] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:11:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:01 user nova-compute[73458]: INFO nova.compute.manager [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Terminating instance
Aug 27 01:12:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-1d18e88d-8fff-4f6f-80b3-e792f14223aa req-42fb5130-f469-4449-a8e1-e1fe69fabfb8 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-unplugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Instance destroyed successfully.
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid c4b43432-4735-496d-a9e9-79a264633d35 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-509786178',display_name='tempest-ServerRescueNegativeTestJSON-server-509786178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-509786178',id=19,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-gd2zn0az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:57:12Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=c4b43432-4735-496d-a9e9-79a264633d35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "ce905a94-63c3-4499-a048-5592b852d701", "address": "fa:16:3e:b6:1e:93", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce905a94-63", "ovs_interfaceid": "ce905a94-63c3-4499-a048-5592b852d701", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG os_vif [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce905a94-63, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:12:02 user nova-compute[73458]: INFO os_vif [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:93,bridge_name='br-int',has_traffic_filtering=True,id=ce905a94-63c3-4499-a048-5592b852d701,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce905a94-63')
Aug 27 01:12:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Deleting instance files /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35_del
Aug 27 01:12:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Deletion of /opt/stack/data/nova/instances/c4b43432-4735-496d-a9e9-79a264633d35_del complete
Aug 27 01:12:02 user nova-compute[73458]: INFO nova.compute.manager [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 01:12:02 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098707.9411647, f714a2a9-c211-4881-9555-97ab44333f9c => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:12:02 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] VM Stopped (Lifecycle Event)
Aug 27 01:12:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8222e120-0095-4175-92f5-89ea2f00573d None None] [instance: f714a2a9-c211-4881-9555-97ab44333f9c] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:03 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Took 0.51 seconds to deallocate network for instance.
Aug 27 01:12:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-0d7dfcbb-8cf2-46a1-9861-71bea74a8212 req-fb70411c-10dc-4ef8-98f3-853124a925d3 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-deleted-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:12:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:03 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Deleted allocations for instance c4b43432-4735-496d-a9e9-79a264633d35
Aug 27 01:12:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f3881992-8243-4cbb-9fe2-78108df2db8f tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "c4b43432-4735-496d-a9e9-79a264633d35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.866s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] Acquiring lock "c4b43432-4735-496d-a9e9-79a264633d35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] Lock "c4b43432-4735-496d-a9e9-79a264633d35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] No waiting events found dispatching network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:04 user nova-compute[73458]: WARNING nova.compute.manager [req-a25be3bf-a16a-497b-9d83-af9b2f266d19 req-fbfb5858-a2a0-43f0-9ce9-5124e1c9a054 service nova] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Received unexpected event network-vif-plugged-ce905a94-63c3-4499-a048-5592b852d701 for instance with vm_state deleted and task_state None.
Aug 27 01:12:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:12:17 user nova-compute[73458]: INFO nova.compute.claims [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Claim successful on node user
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098722.5312674, c4b43432-4735-496d-a9e9-79a264633d35 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:12:17 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: c4b43432-4735-496d-a9e9-79a264633d35] VM Stopped (Lifecycle Event)
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c6a16161-396d-4995-9c44-d59479b0e8f8 None None] [instance: c4b43432-4735-496d-a9e9-79a264633d35] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:12:17 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.policy [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5706f2b84a8148fea7e3c91808d39452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b791d4bc10b648919b7ac2164c0b6709', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:12:17 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Creating image(s)
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "/opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:17 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk 1073741824" returned: 0 in 0.058s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Successfully created port: 33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.215s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Cannot resize image /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Ensure instance console log exists: /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Successfully updated port: 33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquired lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-changed-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG nova.compute.manager [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Refreshing instance network info cache due to event network-changed-33066873-287c-4a85-80af-70031cb53725. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] Acquiring lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:12:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Releasing lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Instance network_info: |[{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] Acquired lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Refreshing network info cache for port 33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Start _get_guest_xml network_info=[{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:12:20 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:12:20 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-25034988',display_name='tempest-AttachVolumeNegativeTest-server-25034988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-25034988',id=39,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWyOajdUPOZy16xf7Yp+lSnDuvRq9bS+LBb8/EwLXujyhIlaYozc2Gn8d62kTCt2cREzrfOWkIzBuUYK25SHDsxAQfeZwy2+4WJg3/M+5oXgv7BK46uIO5CjvrBcsqscQ==',key_name='tempest-keypair-989907300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-jg6dtggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=0ce1347e-2df7-4d8d-8d18-e39bf024b109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:12:20 user nova-compute[73458]:   <uuid>0ce1347e-2df7-4d8d-8d18-e39bf024b109</uuid>
Aug 27 01:12:20 user nova-compute[73458]:   <name>instance-00000027</name>
Aug 27 01:12:20 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:12:20 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:12:20 user nova-compute[73458]:   <metadata>
Aug 27 01:12:20 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:12:20 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:name>tempest-AttachVolumeNegativeTest-server-25034988</nova:name>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:12:20</nova:creationTime>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:12:20 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:12:20 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:owner>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:user uuid="5706f2b84a8148fea7e3c91808d39452">tempest-AttachVolumeNegativeTest-643859675-project-member</nova:user>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:project uuid="b791d4bc10b648919b7ac2164c0b6709">tempest-AttachVolumeNegativeTest-643859675</nova:project>
Aug 27 01:12:20 user nova-compute[73458]:       </nova:owner>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:12:20 user nova-compute[73458]:       <nova:ports>
Aug 27 01:12:20 user nova-compute[73458]:         <nova:port uuid="33066873-287c-4a85-80af-70031cb53725">
Aug 27 01:12:20 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 01:12:20 user nova-compute[73458]:         </nova:port>
Aug 27 01:12:20 user nova-compute[73458]:       </nova:ports>
Aug 27 01:12:20 user nova-compute[73458]:     </nova:instance>
Aug 27 01:12:20 user nova-compute[73458]:   </metadata>
Aug 27 01:12:20 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:12:20 user nova-compute[73458]:     <system>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="serial">0ce1347e-2df7-4d8d-8d18-e39bf024b109</entry>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="uuid">0ce1347e-2df7-4d8d-8d18-e39bf024b109</entry>
Aug 27 01:12:20 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:12:20 user nova-compute[73458]:     </system>
Aug 27 01:12:20 user nova-compute[73458]:   </sysinfo>
Aug 27 01:12:20 user nova-compute[73458]:   <os>
Aug 27 01:12:20 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:12:20 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:12:20 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:12:20 user nova-compute[73458]:   </os>
Aug 27 01:12:20 user nova-compute[73458]:   <features>
Aug 27 01:12:20 user nova-compute[73458]:     <acpi/>
Aug 27 01:12:20 user nova-compute[73458]:     <apic/>
Aug 27 01:12:20 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:12:20 user nova-compute[73458]:   </features>
Aug 27 01:12:20 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:12:20 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:12:20 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:12:20 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:12:20 user nova-compute[73458]:   </clock>
Aug 27 01:12:20 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:12:20 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:12:20 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:12:20 user nova-compute[73458]:   </cpu>
Aug 27 01:12:20 user nova-compute[73458]:   <devices>
Aug 27 01:12:20 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:12:20 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:12:20 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk"/>
Aug 27 01:12:20 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:12:20 user nova-compute[73458]:     </disk>
Aug 27 01:12:20 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:12:20 user nova-compute[73458]:       <mac address="fa:16:3e:b5:96:47"/>
Aug 27 01:12:20 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:12:20 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:12:20 user nova-compute[73458]:       <target dev="tap33066873-28"/>
Aug 27 01:12:20 user nova-compute[73458]:     </interface>
Aug 27 01:12:20 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:12:20 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/console.log" append="off"/>
Aug 27 01:12:20 user nova-compute[73458]:     </serial>
Aug 27 01:12:20 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:12:20 user nova-compute[73458]:     <video>
Aug 27 01:12:20 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:12:20 user nova-compute[73458]:     </video>
Aug 27 01:12:20 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:12:20 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:12:20 user nova-compute[73458]:     </rng>
Aug 27 01:12:20 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:12:20 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:12:20 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:12:20 user nova-compute[73458]:     </memballoon>
Aug 27 01:12:20 user nova-compute[73458]:   </devices>
Aug 27 01:12:20 user nova-compute[73458]: </domain>
Aug 27 01:12:20 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-25034988',display_name='tempest-AttachVolumeNegativeTest-server-25034988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-25034988',id=39,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWyOajdUPOZy16xf7Yp+lSnDuvRq9bS+LBb8/EwLXujyhIlaYozc2Gn8d62kTCt2cREzrfOWkIzBuUYK25SHDsxAQfeZwy2+4WJg3/M+5oXgv7BK46uIO5CjvrBcsqscQ==',key_name='tempest-keypair-989907300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-jg6dtggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:12:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=0ce1347e-2df7-4d8d-8d18-e39bf024b109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG os_vif [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33066873-28, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33066873-28, col_values=(('external_ids', {'iface-id': '33066873-287c-4a85-80af-70031cb53725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:96:47', 'vm-uuid': '0ce1347e-2df7-4d8d-8d18-e39bf024b109'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:20 user nova-compute[73458]: INFO os_vif [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28')
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:b5:96:47, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updated VIF entry in instance network info cache for port 33066873-287c-4a85-80af-70031cb53725. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0e1ea7c-ec68-4607-bf30-a28516693040 req-9f369be2-dd6d-4190-9c45-65ce4912675d service nova] Releasing lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:12:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] No waiting events found dispatching network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:22 user nova-compute[73458]: WARNING nova.compute.manager [req-086dd837-b68e-432b-9860-d94417430e64 req-87f424fa-8d30-4faa-af9a-d845bc68da68 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received unexpected event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 for instance with vm_state building and task_state spawning.
Aug 27 01:12:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098743.68637, 0ce1347e-2df7-4d8d-8d18-e39bf024b109 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] VM Resumed (Lifecycle Event)
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Instance spawned successfully.
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098743.687624, 0ce1347e-2df7-4d8d-8d18-e39bf024b109 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] VM Started (Lifecycle Event)
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:12:23 user nova-compute[73458]: INFO nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 27 01:12:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:24 user nova-compute[73458]: INFO nova.compute.manager [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Took 6.78 seconds to build instance.
Aug 27 01:12:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b573d170-d177-4212-9ed8-c4e7f5035823 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] No waiting events found dispatching network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:24 user nova-compute[73458]: WARNING nova.compute.manager [req-f6332ff3-1451-4c21-bdc8-79fb59922a2b req-af4704a0-2780-468f-9851-3b07d70883ab service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received unexpected event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 for instance with vm_state active and task_state None.
Aug 27 01:12:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:33 user nova-compute[73458]: INFO nova.compute.manager [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Terminating instance
Aug 27 01:12:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-4f474105-87a0-4cea-933b-3a2ce835d9b4 req-594bfa9b-fc1a-4420-82a4-4b16357f0adb service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-unplugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:34 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Instance destroyed successfully.
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 85e602b0-6c12-4d09-825c-ececd08c663a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1715805118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1715805118',id=21,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-pt4850kd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:00:30Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=85e602b0-6c12-4d09-825c-ececd08c663a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "address": "fa:16:3e:78:ed:e7", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef531fea-3d", "ovs_interfaceid": "ef531fea-3dc7-46ee-99e3-c224e729dc9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_vif [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef531fea-3d, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:12:34 user nova-compute[73458]: INFO os_vif [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:ed:e7,bridge_name='br-int',has_traffic_filtering=True,id=ef531fea-3dc7-46ee-99e3-c224e729dc9c,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef531fea-3d')
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwDUqrSt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:12:34 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dbac5e-d8a4-4b74-a5fb-fe5341eb7793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0743fff-549b-40bb-a59b-1fbaab79d9c2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:12:34 user nova-compute[73458]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:12:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 (non-flash)
Aug 27 01:12:34 user nova-compute[73458]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:12:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e785191b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[621669d0-d2cb-4dac-b3e6-dbc1fff462f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f489496-be1a-462f-87c5-b84861797526]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f49d65-5f8a-40d9-9e8d-8b038961be7d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[01052956-3b2f-450a-9042-66be78b2e7c7]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c145c4-d4f4-46d8-9275-3af0c97121ba]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd844a66-3d14-453c-ac9e-58ef603b62ad]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260]
Aug 27 01:12:34 user nova-compute[73458]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8, portal: 172.16.0.220,3260] successful.
Aug 27 01:12:34 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8715b73e-094f-4742-a399-65c61abcb6c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0711b2c4-d101-40b0-b70d-df439c356097]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] <== disconnect_volume: return (284ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:12:34 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Deleting instance files /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a_del
Aug 27 01:12:34 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Deletion of /opt/stack/data/nova/instances/85e602b0-6c12-4d09-825c-ececd08c663a_del complete
Aug 27 01:12:34 user nova-compute[73458]: INFO nova.compute.manager [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 01:12:34 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:12:34 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:35 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Took 0.56 seconds to deallocate network for instance.
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-52bf6cee-a7d2-4876-8386-4efb1916c8c4 req-c7c87ad8-0e0f-45c3-b390-4e5be3495150 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-deleted-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:35 user nova-compute[73458]: INFO nova.compute.manager [req-52bf6cee-a7d2-4876-8386-4efb1916c8c4 req-c7c87ad8-0e0f-45c3-b390-4e5be3495150 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Neutron deleted interface ef531fea-3dc7-46ee-99e3-c224e729dc9c; detaching it from the instance and deleting it from the info cache
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.network.neutron [req-52bf6cee-a7d2-4876-8386-4efb1916c8c4 req-c7c87ad8-0e0f-45c3-b390-4e5be3495150 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-52bf6cee-a7d2-4876-8386-4efb1916c8c4 req-c7c87ad8-0e0f-45c3-b390-4e5be3495150 service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Detach interface failed, port_id=ef531fea-3dc7-46ee-99e3-c224e729dc9c, reason: Instance 85e602b0-6c12-4d09-825c-ececd08c663a could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] Acquiring lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] Lock "85e602b0-6c12-4d09-825c-ececd08c663a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] No waiting events found dispatching network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:35 user nova-compute[73458]: WARNING nova.compute.manager [req-95ca4cba-3b4a-4c0f-8838-00384fee36c6 req-6bc098ad-1e0d-47d3-934c-be5c0abe15cf service nova] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Received unexpected event network-vif-plugged-ef531fea-3dc7-46ee-99e3-c224e729dc9c for instance with vm_state active and task_state deleting.
Aug 27 01:12:36 user nova-compute[73458]: INFO nova.compute.manager [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Took 1.00 seconds to detach 1 volumes for instance.
Aug 27 01:12:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:36 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:12:36 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:12:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:36 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Deleted allocations for instance 85e602b0-6c12-4d09-825c-ececd08c663a
Aug 27 01:12:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9a15bbcd-9204-4348-9367-b11b5bc91ad5 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "85e602b0-6c12-4d09-825c-ececd08c663a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.151s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:12:39 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:12:39 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=7896MB free_disk=25.261703491210938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 97832e51-8a29-4073-b61e-e2aa479e58c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:12:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:12:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:12:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:12:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:12:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:49 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098754.0950382, 85e602b0-6c12-4d09-825c-ececd08c663a => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:12:49 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] VM Stopped (Lifecycle Event)
Aug 27 01:12:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-cf9c0bf4-397c-4c1f-9c80-4dade7c72fef None None] [instance: 85e602b0-6c12-4d09-825c-ececd08c663a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:12:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:52 user nova-compute[73458]: INFO nova.compute.manager [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Terminating instance
Aug 27 01:12:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-1fc9a541-22d1-481e-a30b-01d9834875ca req-96d525eb-ff1b-4098-bc7b-7814feaf66c0 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-unplugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Instance destroyed successfully.
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lazy-loading 'resources' on Instance uuid 8377d9b5-a8c1-48be-be16-be1ace928d3f {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:55:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-65952474',display_name='tempest-ServerRescueNegativeTestJSON-server-65952474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-65952474',id=18,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd1972e3c8fd486bac81a90b489714ad',ramdisk_id='',reservation_id='r-fep447l3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-859054648',owner_user_name='tempest-ServerRescueNegativeTestJSON-859054648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:02:02Z,user_data=None,user_id='b1a7573d764b4cc0a7af57c45323c4f9',uuid=8377d9b5-a8c1-48be-be16-be1ace928d3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converting VIF {"id": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "address": "fa:16:3e:9e:a8:83", "network": {"id": "86832e3c-0828-46d6-9d69-83f4057cbe7e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-843997541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd1972e3c8fd486bac81a90b489714ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de9d84c-1e", "ovs_interfaceid": "9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG os_vif [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9de9d84c-1e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:12:53 user nova-compute[73458]: INFO os_vif [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9,network=Network(86832e3c-0828-46d6-9d69-83f4057cbe7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de9d84c-1e')
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Deleting instance files /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f_del
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Deletion of /opt/stack/data/nova/instances/8377d9b5-a8c1-48be-be16-be1ace928d3f_del complete
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.compute.manager [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 01:12:53 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Took 0.62 seconds to deallocate network for instance.
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-e5aa9bac-cbc1-4d37-8f9c-424ac1e649f0 req-a340673b-176f-45f5-9790-4f9e4b0b485d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-deleted-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:53 user nova-compute[73458]: INFO nova.compute.manager [req-e5aa9bac-cbc1-4d37-8f9c-424ac1e649f0 req-a340673b-176f-45f5-9790-4f9e4b0b485d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Neutron deleted interface 9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9; detaching it from the instance and deleting it from the info cache
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.network.neutron [req-e5aa9bac-cbc1-4d37-8f9c-424ac1e649f0 req-a340673b-176f-45f5-9790-4f9e4b0b485d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-e5aa9bac-cbc1-4d37-8f9c-424ac1e649f0 req-a340673b-176f-45f5-9790-4f9e4b0b485d service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Detach interface failed, port_id=9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9, reason: Instance 8377d9b5-a8c1-48be-be16-be1ace928d3f could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:54 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Deleted allocations for instance 8377d9b5-a8c1-48be-be16-be1ace928d3f
Aug 27 01:12:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ae15dee-21c4-4267-b2f4-315b62bc7133 tempest-ServerRescueNegativeTestJSON-859054648 tempest-ServerRescueNegativeTestJSON-859054648-project-member] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.949s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] Acquiring lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] Lock "8377d9b5-a8c1-48be-be16-be1ace928d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:12:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] No waiting events found dispatching network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:12:54 user nova-compute[73458]: WARNING nova.compute.manager [req-c827b9d0-2b14-4bfd-bcf3-feb31f66bf9a req-6358d4ac-49ca-4b6d-b8a0-31cfdb786751 service nova] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Received unexpected event network-vif-plugged-9de9d84c-1ee3-40d3-8fd4-679a9c4c3ca9 for instance with vm_state deleted and task_state None.
Aug 27 01:12:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:12:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:13:05 user nova-compute[73458]: INFO nova.compute.claims [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Claim successful on node user
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:13:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.policy [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e8655de65e14eedb2eb239b20fe697f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaf1e6e531a4d53a6f275560bbb93a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:13:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Creating image(s)
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "/opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "/opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "/opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk 1073741824" returned: 0 in 0.069s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.235s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Successfully created port: 42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Cannot resize image /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Ensure instance console log exists: /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Successfully updated port: 42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquired lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-changed-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Refreshing instance network info cache due to event network-changed-42d08d14-a62d-4f82-b3cd-3349fe288314. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] Acquiring lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating instance_info_cache with network_info: [{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Releasing lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Instance network_info: |[{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:13:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] Acquired lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Refreshing network info cache for port 42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Start _get_guest_xml network_info=[{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:13:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:13:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2084733235',display_name='tempest-VolumesSnapshotTestJSON-instance-2084733235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2084733235',id=40,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDLScpgw+fYw2+gg/woQEv9UtrrLI9J/3TMyjoenQCj7kW8v9subhazsHP3FZPwV2AdHghyuGKz2x75ymdDUfK+lBvQvEGCQ4GbBThmw6sIYiCYJLtxh77I8KwK+wmo1w==',key_name='tempest-keypair-499682637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-sqk0kaht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=39d37612-adc1-4157-bee5-b5b6fd73bdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'pci_devices' on Instance uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:13:08 user nova-compute[73458]:   <uuid>39d37612-adc1-4157-bee5-b5b6fd73bdb6</uuid>
Aug 27 01:13:08 user nova-compute[73458]:   <name>instance-00000028</name>
Aug 27 01:13:08 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:13:08 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:13:08 user nova-compute[73458]:   <metadata>
Aug 27 01:13:08 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:13:08 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2084733235</nova:name>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:13:08</nova:creationTime>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:13:08 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:13:08 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:owner>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:user uuid="9e8655de65e14eedb2eb239b20fe697f">tempest-VolumesSnapshotTestJSON-677137363-project-member</nova:user>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:project uuid="bdaf1e6e531a4d53a6f275560bbb93a0">tempest-VolumesSnapshotTestJSON-677137363</nova:project>
Aug 27 01:13:08 user nova-compute[73458]:       </nova:owner>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:13:08 user nova-compute[73458]:       <nova:ports>
Aug 27 01:13:08 user nova-compute[73458]:         <nova:port uuid="42d08d14-a62d-4f82-b3cd-3349fe288314">
Aug 27 01:13:08 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 01:13:08 user nova-compute[73458]:         </nova:port>
Aug 27 01:13:08 user nova-compute[73458]:       </nova:ports>
Aug 27 01:13:08 user nova-compute[73458]:     </nova:instance>
Aug 27 01:13:08 user nova-compute[73458]:   </metadata>
Aug 27 01:13:08 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:13:08 user nova-compute[73458]:     <system>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="serial">39d37612-adc1-4157-bee5-b5b6fd73bdb6</entry>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="uuid">39d37612-adc1-4157-bee5-b5b6fd73bdb6</entry>
Aug 27 01:13:08 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:13:08 user nova-compute[73458]:     </system>
Aug 27 01:13:08 user nova-compute[73458]:   </sysinfo>
Aug 27 01:13:08 user nova-compute[73458]:   <os>
Aug 27 01:13:08 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:13:08 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:13:08 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:13:08 user nova-compute[73458]:   </os>
Aug 27 01:13:08 user nova-compute[73458]:   <features>
Aug 27 01:13:08 user nova-compute[73458]:     <acpi/>
Aug 27 01:13:08 user nova-compute[73458]:     <apic/>
Aug 27 01:13:08 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:13:08 user nova-compute[73458]:   </features>
Aug 27 01:13:08 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:13:08 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:13:08 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:13:08 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:13:08 user nova-compute[73458]:   </clock>
Aug 27 01:13:08 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:13:08 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:13:08 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:13:08 user nova-compute[73458]:   </cpu>
Aug 27 01:13:08 user nova-compute[73458]:   <devices>
Aug 27 01:13:08 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:13:08 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:13:08 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk"/>
Aug 27 01:13:08 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:13:08 user nova-compute[73458]:     </disk>
Aug 27 01:13:08 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:13:08 user nova-compute[73458]:       <mac address="fa:16:3e:ae:b8:cc"/>
Aug 27 01:13:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:13:08 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:13:08 user nova-compute[73458]:       <target dev="tap42d08d14-a6"/>
Aug 27 01:13:08 user nova-compute[73458]:     </interface>
Aug 27 01:13:08 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:13:08 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/console.log" append="off"/>
Aug 27 01:13:08 user nova-compute[73458]:     </serial>
Aug 27 01:13:08 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:13:08 user nova-compute[73458]:     <video>
Aug 27 01:13:08 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:13:08 user nova-compute[73458]:     </video>
Aug 27 01:13:08 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:13:08 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:13:08 user nova-compute[73458]:     </rng>
Aug 27 01:13:08 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:13:08 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:13:08 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:13:08 user nova-compute[73458]:     </memballoon>
Aug 27 01:13:08 user nova-compute[73458]:   </devices>
Aug 27 01:13:08 user nova-compute[73458]: </domain>
Aug 27 01:13:08 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2084733235',display_name='tempest-VolumesSnapshotTestJSON-instance-2084733235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2084733235',id=40,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDLScpgw+fYw2+gg/woQEv9UtrrLI9J/3TMyjoenQCj7kW8v9subhazsHP3FZPwV2AdHghyuGKz2x75ymdDUfK+lBvQvEGCQ4GbBThmw6sIYiCYJLtxh77I8KwK+wmo1w==',key_name='tempest-keypair-499682637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-sqk0kaht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=39d37612-adc1-4157-bee5-b5b6fd73bdb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG os_vif [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42d08d14-a6, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42d08d14-a6, col_values=(('external_ids', {'iface-id': '42d08d14-a62d-4f82-b3cd-3349fe288314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:b8:cc', 'vm-uuid': '39d37612-adc1-4157-bee5-b5b6fd73bdb6'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098773.1345034, 8377d9b5-a8c1-48be-be16-be1ace928d3f => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:13:08 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] VM Stopped (Lifecycle Event)
Aug 27 01:13:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:08 user nova-compute[73458]: INFO os_vif [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6')
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-5f9e119b-89c7-420c-b2a3-d526435aab9b None None] [instance: 8377d9b5-a8c1-48be-be16-be1ace928d3f] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No VIF found with MAC fa:16:3e:ae:b8:cc, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updated VIF entry in instance network info cache for port 42d08d14-a62d-4f82-b3cd-3349fe288314. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating instance_info_cache with network_info: [{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c32e23ee-3d15-4571-819f-b176cdbc9811 req-cff9f198-1827-4701-9ee3-c0352ed95b5f service nova] Releasing lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:09 user nova-compute[73458]: DEBUG nova.compute.manager [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] No waiting events found dispatching network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:09 user nova-compute[73458]: WARNING nova.compute.manager [req-2ebaa4e6-8430-4b0e-8d79-d1e7e655f140 req-92816271-9c06-4acf-9cf0-7ce9328b115f service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received unexpected event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 for instance with vm_state building and task_state spawning.
Aug 27 01:13:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] No waiting events found dispatching network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:11 user nova-compute[73458]: WARNING nova.compute.manager [req-56ace380-41e4-4ca4-91e4-1370304a223b req-a820ec7c-06b9-420f-a795-f7517d99a633 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received unexpected event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 for instance with vm_state building and task_state spawning.
Aug 27 01:13:11 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098791.9923127, 39d37612-adc1-4157-bee5-b5b6fd73bdb6 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:13:11 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] VM Resumed (Lifecycle Event)
Aug 27 01:13:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:13:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Instance spawned successfully.
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098791.9961932, 39d37612-adc1-4157-bee5-b5b6fd73bdb6 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] VM Started (Lifecycle Event)
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 27 01:13:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:13:12 user nova-compute[73458]: INFO nova.compute.manager [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Took 7.10 seconds to build instance.
Aug 27 01:13:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-68b15943-78b6-475c-a534-2a61c6aea051 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.331s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-changed-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.compute.manager [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Refreshing instance network info cache due to event network-changed-687707d0-3599-4e1f-b18f-275cb30c6819. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] Acquiring lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] Acquired lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Refreshing network info cache for port 687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:24 user nova-compute[73458]: INFO nova.compute.manager [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Terminating instance
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updated VIF entry in instance network info cache for port 687707d0-3599-4e1f-b18f-275cb30c6819. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating instance_info_cache with network_info: [{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f867bd80-6d62-4d4f-9c56-9a166a7f6e39 req-3699d69f-3689-4763-a3b3-f2bd31c583b8 service nova] Releasing lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Instance destroyed successfully.
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.objects.instance [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lazy-loading 'resources' on Instance uuid 2317c1cf-8971-489e-928f-93a3a0ddf2b8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T00:53:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-655930893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-655930893',id=15,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T00:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3537b33489d84282958ddf05f58ade1e',ramdisk_id='',reservation_id='r-9jhm8sfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-635602081',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T00:55:42Z,user_data=None,user_id='9a452f9412de4c8d881d30b02c01d3a9',uuid=2317c1cf-8971-489e-928f-93a3a0ddf2b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converting VIF {"id": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "address": "fa:16:3e:b0:0d:7b", "network": {"id": "60d8968d-cc6d-4548-8966-57ee48cbe037", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1477727266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3537b33489d84282958ddf05f58ade1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d2ba39-30", "ovs_interfaceid": "42d2ba39-30e8-4a52-95e8-d83183cc6c18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG os_vif [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42d2ba39-30, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:13:25 user nova-compute[73458]: INFO os_vif [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:0d:7b,bridge_name='br-int',has_traffic_filtering=True,id=42d2ba39-30e8-4a52-95e8-d83183cc6c18,network=Network(60d8968d-cc6d-4548-8966-57ee48cbe037),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d2ba39-30')
Aug 27 01:13:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Deleting instance files /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8_del
Aug 27 01:13:25 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Deletion of /opt/stack/data/nova/instances/2317c1cf-8971-489e-928f-93a3a0ddf2b8_del complete
Aug 27 01:13:25 user nova-compute[73458]: INFO nova.compute.manager [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 27 01:13:25 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-unplugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-unplugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-unplugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:26 user nova-compute[73458]: WARNING nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state active and task_state deleting.
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:26 user nova-compute[73458]: WARNING nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state active and task_state deleting.
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:26 user nova-compute[73458]: WARNING nova.compute.manager [req-1f52fd7b-e036-4908-9cdd-f69bfe3ce70a req-10018115-8af4-4fa6-a83e-9b3772f2814f service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state active and task_state deleting.
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:26 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Took 1.17 seconds to deallocate network for instance.
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:26 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Deleted allocations for instance 2317c1cf-8971-489e-928f-93a3a0ddf2b8
Aug 27 01:13:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-064d913c-ade2-40e7-9fbf-3676d830cfb8 tempest-ServerBootFromVolumeStableRescueTest-635602081 tempest-ServerBootFromVolumeStableRescueTest-635602081-project-member] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.780s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] Acquiring lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] Lock "2317c1cf-8971-489e-928f-93a3a0ddf2b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] No waiting events found dispatching network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:13:28 user nova-compute[73458]: WARNING nova.compute.manager [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received unexpected event network-vif-plugged-42d2ba39-30e8-4a52-95e8-d83183cc6c18 for instance with vm_state deleted and task_state None.
Aug 27 01:13:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-73b3ec26-7246-4016-9221-59d2a2b6d604 req-7423aa9d-634c-4054-9aed-17d4c2e87d21 service nova] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Received event network-vif-deleted-42d2ba39-30e8-4a52-95e8-d83183cc6c18 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:34 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-changed-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Refreshing instance network info cache due to event network-changed-fedfe353-6b96-4dbc-971b-8a966068a4e2. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:13:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] Acquiring lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] Acquired lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Refreshing network info cache for port fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:13:38 user nova-compute[73458]: DEBUG nova.network.neutron [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updated VIF entry in instance network info cache for port fedfe353-6b96-4dbc-971b-8a966068a4e2. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:13:38 user nova-compute[73458]: DEBUG nova.network.neutron [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating instance_info_cache with network_info: [{"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-75861c57-83ad-42b9-8e52-fd9b92b5ce56 req-5babece1-89ee-4d20-a068-2ed690f1314d service nova] Releasing lock "refresh_cache-4b3de184-3578-4f0a-8433-9e7e1f5625f8" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:13:39 user nova-compute[73458]: INFO nova.compute.claims [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Claim successful on node user
Aug 27 01:13:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:39 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:13:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:13:40 user nova-compute[73458]: INFO nova.virt.block_device [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Booting with volume snapshot 8593cf75-eca7-45ba-a310-82cf23a70d3d at /dev/vda
Aug 27 01:13:40 user nova-compute[73458]: DEBUG nova.policy [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098805.052456, 2317c1cf-8971-489e-928f-93a3a0ddf2b8 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:13:40 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] VM Stopped (Lifecycle Event)
Aug 27 01:13:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-28b7380b-9361-4b15-a8c3-f2cb0e08a18b None None] [instance: 2317c1cf-8971-489e-928f-93a3a0ddf2b8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Successfully created port: c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:13:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:13:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8029MB free_disk=25.353946685791016GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 97832e51-8a29-4073-b61e-e2aa479e58c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b981719b-a3c3-41c9-bc33-44aa03774c5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:13:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Successfully updated port: c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-changed-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.compute.manager [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Refreshing instance network info cache due to event network-changed-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] Acquiring lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:13:42 user nova-compute[73458]: INFO nova.compute.manager [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attaching volume 28a85914-b61d-4fd7-9f71-d47cdfaf40f3 to /dev/vdb
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.utils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3ab72-1c65-4f24-b19c-dddedb2b4010]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updating instance_info_cache with network_info: [{"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1442e-d709-4755-a126-10ac15bdfef6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Instance network_info: |[{"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] Acquired lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Refreshing network info cache for port c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f821882f-8b4c-4b11-82c1-030835a5d8d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd0bca2-27d1-4b46-a97d-5f02f92db20f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:13:42 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:13:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef440d-5407-47b6-9bf3-f9fd10dd48f5]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG os_brick.utils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:13:42 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating existing volume attachment record: 180afb97-f586-46f5-9a6c-0ee38eab4d9e {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:13:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:13:43 user nova-compute[73458]: DEBUG nova.network.neutron [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updated VIF entry in instance network info cache for port c99ff0d7-82e6-46cb-a6e9-893f0a124bc4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:13:43 user nova-compute[73458]: DEBUG nova.network.neutron [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updating instance_info_cache with network_info: [{"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-41a1beb9-33d1-4b80-8994-9b13e7f9a5ae req-bfc57166-dfff-4819-8544-806306d00e3d service nova] Releasing lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 97832e51-8a29-4073-b61e-e2aa479e58c6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating instance_info_cache with network_info: [{"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-97832e51-8a29-4073-b61e-e2aa479e58c6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:13:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:13:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGUBoHQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:13:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:13:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:13:54 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea1a1f-7186-448c-b10c-9c07ca40c77f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:13:54 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0071f6-7969-4042-83c0-f7a5acc673a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3] added
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50daca-aaa7-452b-a2eb-a95f5667d0cf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[528c06b6-1617-4821-9250-429e205e5ba6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGUBoHQT {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rGUBoHQT" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed38ca1-3fa7-4e2d-bca2-8ed2fcb0d9be]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rGUBoHQT'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb140d7e-40e0-496f-ab1e-85a95d092825]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[498fb2ce-9b96-4dbe-9d2d-15abdfe796ce]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a664ae-b2fd-4c17-8232-dd5d16927eca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260]
Aug 27 01:13:54 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260] successful.
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d88675-5017-4bf6-a09f-0b881c42b7ec]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07b635e-830c-40e1-9443-3e0a20aed51c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:13:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5937f5a-612c-413e-9cea-137d2c599127]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:13:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGUBoHQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26338343136643933', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338343136643933', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:13:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:13:55 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:13:55 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:13:55 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:13:55 user nova-compute[73458]:   <serial>28a85914-b61d-4fd7-9f71-d47cdfaf40f3</serial>
Aug 27 01:13:55 user nova-compute[73458]: </disk>
Aug 27 01:13:55 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac01858-66ca-44bb-9c04-516a3b730771]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b333ae8e-cc33-4162-8964-0d856eac146b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6d5e6-aa39-4721-a290-50bafeb7a839]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265f975-3ee2-4c84-b4e2-381450ca4adb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:13:56 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c216919-2088-4aa3-aa15-6ee39e72ecfe]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updating existing volume attachment record: bac61563-db0c-40ed-92dd-473047091751 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No VIF found with MAC fa:16:3e:96:e0:f9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:13:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b9149343-5320-4ed5-adc7-66233bdabf1a tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.842s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:13:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:01 user nova-compute[73458]: INFO nova.compute.manager [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attaching volume cda9ab3f-de39-4ac7-a3c4-af284554208a to /dev/vdc
Aug 27 01:14:01 user nova-compute[73458]: DEBUG os_brick.utils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c578909-0b62-49b0-8202-09e18fe72db1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e790f-3d0b-4d61-9b39-df6f916d9740]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90087dc8-5878-440e-81cc-2c1f2035508c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[246c99c0-2a9e-4393-9888-6e43623fafd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:02 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:14:02 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f66ed35-6229-482f-949f-217cb8ae6484]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG os_brick.utils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:02 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating existing volume attachment record: f74b7fc5-de83-4163-ba11-7b79a2af3069 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:14:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:14:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Creating image(s)
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Ensure instance console log exists: /opt/stack/data/nova/instances/b981719b-a3c3-41c9-bc33-44aa03774c5b/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Start _get_guest_xml network_info=[{"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T01:13:26Z,direct_url=<?>,disk_format='qcow2',id=d4193c0e-eee5-4a5b-8be4-6f0a50b5c873,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-41464808',owner='8111339cd39e4794a9fc40649e480c2b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T01:13:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGlMiKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b981719b-a3c3-41c9-bc33-44aa03774c5b', 'attached_at': '', 'detached_at': '', 'volume_id': '12717935-deb9-4abd-8b76-11d65560a078', 'serial': '12717935-deb9-4abd-8b76-11d65560a078'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'bac61563-db0c-40ed-92dd-473047091751', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:14:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:14:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T01:13:26Z,direct_url=<?>,disk_format='qcow2',id=d4193c0e-eee5-4a5b-8be4-6f0a50b5c873,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-41464808',owner='8111339cd39e4794a9fc40649e480c2b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T01:13:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGlMiKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:08 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a903426-85eb-4059-ac56-8c044a7e8dd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:14:08 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89d9c5-2320-4f6d-84a9-7ea73c581326]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078] added
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c1f0ec-d9ba-481d-9cef-61e997b00c86]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8504f90c-c4c7-4de9-a220-64d0aa417d33]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGlMiKsX {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-changed-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.compute.manager [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Refreshing instance network info cache due to event network-changed-33066873-287c-4a85-80af-70031cb53725. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] Acquiring lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] Acquired lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Refreshing network info cache for port 33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dGlMiKsX" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3584dc01-3caf-485d-a4c4-d75d20d2b144]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dGlMiKsX'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5b3ba2-1939-4c74-9d1e-0e1a5bb2a017]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[25950da6-2362-42be-a119-8c9a71bc5e3e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c501c2-18c3-470d-b406-fd517caaaf46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260]
Aug 27 01:14:08 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03bf07-2f0a-4ed4-833c-2d61881d4661]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[30295633-517d-430a-a52c-052aa0912b62]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a95eae-8ef8-4556-bb30-34c06ffed356]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:14:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGlMiKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updated VIF entry in instance network info cache for port 33066873-287c-4a85-80af-70031cb53725. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.neutron [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e8466e04-30c0-41d4-a56c-07d2857b8602 req-6a5619ac-c013-4d2f-a081-45bd7f1b0a5c service nova] Releasing lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26631373464333939', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631373464333939', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-784007792',id=41,image_ref='d4193c0e-eee5-4a5b-8be4-6f0a50b5c873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhspJOCnM/1fTajvNOB1bUHEfGLc1YT0doP2/Bg090cwbfgMGq0BHvQ/gMMVsqpHBHw4f4oO38g33zctTwYgebqCehjSlSnMfxmZvx51/HoB0ebhu8zG7ufjuzWTbzCKg==',key_name='tempest-keypair-1597203146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-ps1tdrap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1099761153',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=b981719b-a3c3-41c9-bc33-44aa03774c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid b981719b-a3c3-41c9-bc33-44aa03774c5b {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:14:09 user nova-compute[73458]:   <uuid>b981719b-a3c3-41c9-bc33-44aa03774c5b</uuid>
Aug 27 01:14:09 user nova-compute[73458]:   <name>instance-00000029</name>
Aug 27 01:14:09 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:14:09 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:14:09 user nova-compute[73458]:   <metadata>
Aug 27 01:14:09 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:14:09 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-784007792</nova:name>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:14:08</nova:creationTime>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:14:09 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:14:09 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:owner>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:14:09 user nova-compute[73458]:       </nova:owner>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:root type="image" uuid="d4193c0e-eee5-4a5b-8be4-6f0a50b5c873"/>
Aug 27 01:14:09 user nova-compute[73458]:       <nova:ports>
Aug 27 01:14:09 user nova-compute[73458]:         <nova:port uuid="c99ff0d7-82e6-46cb-a6e9-893f0a124bc4">
Aug 27 01:14:09 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 01:14:09 user nova-compute[73458]:         </nova:port>
Aug 27 01:14:09 user nova-compute[73458]:       </nova:ports>
Aug 27 01:14:09 user nova-compute[73458]:     </nova:instance>
Aug 27 01:14:09 user nova-compute[73458]:   </metadata>
Aug 27 01:14:09 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:14:09 user nova-compute[73458]:     <system>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="serial">b981719b-a3c3-41c9-bc33-44aa03774c5b</entry>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="uuid">b981719b-a3c3-41c9-bc33-44aa03774c5b</entry>
Aug 27 01:14:09 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:14:09 user nova-compute[73458]:     </system>
Aug 27 01:14:09 user nova-compute[73458]:   </sysinfo>
Aug 27 01:14:09 user nova-compute[73458]:   <os>
Aug 27 01:14:09 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:14:09 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:14:09 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:14:09 user nova-compute[73458]:   </os>
Aug 27 01:14:09 user nova-compute[73458]:   <features>
Aug 27 01:14:09 user nova-compute[73458]:     <acpi/>
Aug 27 01:14:09 user nova-compute[73458]:     <apic/>
Aug 27 01:14:09 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:14:09 user nova-compute[73458]:   </features>
Aug 27 01:14:09 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:14:09 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:14:09 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:14:09 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:14:09 user nova-compute[73458]:   </clock>
Aug 27 01:14:09 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:14:09 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:14:09 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:14:09 user nova-compute[73458]:   </cpu>
Aug 27 01:14:09 user nova-compute[73458]:   <devices>
Aug 27 01:14:09 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:14:09 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:09 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 01:14:09 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:14:09 user nova-compute[73458]:       <serial>12717935-deb9-4abd-8b76-11d65560a078</serial>
Aug 27 01:14:09 user nova-compute[73458]:     </disk>
Aug 27 01:14:09 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:14:09 user nova-compute[73458]:       <mac address="fa:16:3e:f1:d6:f8"/>
Aug 27 01:14:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:14:09 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:14:09 user nova-compute[73458]:       <target dev="tapc99ff0d7-82"/>
Aug 27 01:14:09 user nova-compute[73458]:     </interface>
Aug 27 01:14:09 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:14:09 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/b981719b-a3c3-41c9-bc33-44aa03774c5b/console.log" append="off"/>
Aug 27 01:14:09 user nova-compute[73458]:     </serial>
Aug 27 01:14:09 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:14:09 user nova-compute[73458]:     <video>
Aug 27 01:14:09 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:14:09 user nova-compute[73458]:     </video>
Aug 27 01:14:09 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:14:09 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:14:09 user nova-compute[73458]:     </rng>
Aug 27 01:14:09 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:14:09 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:14:09 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:14:09 user nova-compute[73458]:     </memballoon>
Aug 27 01:14:09 user nova-compute[73458]:   </devices>
Aug 27 01:14:09 user nova-compute[73458]: </domain>
Aug 27 01:14:09 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-784007792',id=41,image_ref='d4193c0e-eee5-4a5b-8be4-6f0a50b5c873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhspJOCnM/1fTajvNOB1bUHEfGLc1YT0doP2/Bg090cwbfgMGq0BHvQ/gMMVsqpHBHw4f4oO38g33zctTwYgebqCehjSlSnMfxmZvx51/HoB0ebhu8zG7ufjuzWTbzCKg==',key_name='tempest-keypair-1597203146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-ps1tdrap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1099761153',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:13:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=b981719b-a3c3-41c9-bc33-44aa03774c5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG os_vif [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc99ff0d7-82, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc99ff0d7-82, col_values=(('external_ids', {'iface-id': 'c99ff0d7-82e6-46cb-a6e9-893f0a124bc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:d6:f8', 'vm-uuid': 'b981719b-a3c3-41c9-bc33-44aa03774c5b'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:14:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:09 user nova-compute[73458]: INFO os_vif [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82')
Aug 27 01:14:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:10 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:f1:d6:f8, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] No waiting events found dispatching network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:14:11 user nova-compute[73458]: WARNING nova.compute.manager [req-a51b1fa0-e640-4c6e-9ba0-393f6d321d04 req-979c57a9-386c-4780-8cd2-4dcaf2e7c8fa service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received unexpected event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 for instance with vm_state building and task_state spawning.
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098853.6120088, b981719b-a3c3-41c9-bc33-44aa03774c5b => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] VM Resumed (Lifecycle Event)
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Instance spawned successfully.
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693098853.6139348, b981719b-a3c3-41c9-bc33-44aa03774c5b => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] VM Started (Lifecycle Event)
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Took 5.28 seconds to spawn the instance on the hypervisor.
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] No waiting events found dispatching network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:14:13 user nova-compute[73458]: WARNING nova.compute.manager [req-590abf57-0bda-4d7c-bbef-0e02b997a376 req-8b0f2ea1-a90c-4c27-ab70-ead1b79d878f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received unexpected event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 for instance with vm_state building and task_state spawning.
Aug 27 01:14:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Took 34.52 seconds to build instance.
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-921f3e84-6acd-4e15-aa18-4be385913e3e tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.618s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:13 user nova-compute[73458]: INFO nova.compute.manager [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Attaching volume 26fcd4b2-e761-4d3b-83d4-214fa67d3db0 to /dev/vdb
Aug 27 01:14:13 user nova-compute[73458]: DEBUG os_brick.utils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0375639-82c6-49fe-b59e-fab8409fcc5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b11e106-356a-4c85-b44d-28eb116dd8fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2aa624-5d41-4a54-9f7d-64a1b2886ae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65a09d-8687-4502-b895-b534a67c7dea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:14 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa240ed5-2489-442b-a173-9cf25d017950]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.utils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating existing volume attachment record: a2ef89e3-696e-41b1-a4ed-0497e05160f3 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAixXSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:14 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:14 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:14 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33e3ab-16f8-4737-befb-419317c2473a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:14:14 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda79e85-61cd-4f09-9dc7-96a7863a8782]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a] added
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8b5be-63b7-4a5a-bb3a-1eb798c0fb30]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65565fc-c0ad-4580-87b3-af91dcb757a0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVAixXSu {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVAixXSu" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb795e5-7d27-47b1-a389-765695e202c0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vVAixXSu'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f65f6-9340-4087-86d8-46fe926ad8fd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6345beb-b921-4d49-af53-57e662271e89]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6325ec-14df-48e3-9aeb-39aee228005b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260]
Aug 27 01:14:14 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48bad2d-1b38-4370-a1e7-b053df84dcf7]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df824ba-671b-4556-948c-949c9ac8547b]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:14 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:14 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.398s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed3479-b215-417a-adf6-ab9278db7e59]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:14:14 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAixXSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23733396432373432', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733396432373432', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:14:15 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:15 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:14:15 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:14:15 user nova-compute[73458]:   <serial>cda9ab3f-de39-4ac7-a3c4-af284554208a</serial>
Aug 27 01:14:15 user nova-compute[73458]: </disk>
Aug 27 01:14:15 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:14:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] No VIF found with MAC fa:16:3e:96:e0:f9, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:14:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d690be93-8069-4d69-a7a7-94e79e968376 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.501s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:17 user nova-compute[73458]: INFO nova.compute.manager [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Detaching volume 28a85914-b61d-4fd7-9f71-d47cdfaf40f3
Aug 27 01:14:17 user nova-compute[73458]: INFO nova.virt.block_device [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attempting to driver detach volume 28a85914-b61d-4fd7-9f71-d47cdfaf40f3 from mountpoint /dev/vdb
Aug 27 01:14:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Attempting to detach device vdb from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:14:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:17 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:17 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:14:17 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:14:17 user nova-compute[73458]:   <serial>28a85914-b61d-4fd7-9f71-d47cdfaf40f3</serial>
Aug 27 01:14:17 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:14:17 user nova-compute[73458]: </disk>
Aug 27 01:14:17 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:17 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdb from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the persistent domain config.
Aug 27 01:14:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:14:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:17 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:17 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:14:17 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:14:17 user nova-compute[73458]:   <serial>28a85914-b61d-4fd7-9f71-d47cdfaf40f3</serial>
Aug 27 01:14:17 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:14:17 user nova-compute[73458]: </disk>
Aug 27 01:14:17 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098858.0296898, 4b3de184-3578-4f0a-8433-9e7e1f5625f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:14:18 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdb from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the live domain config.
Aug 27 01:14:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rGUBoHQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:18 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd91fb3e-87ab-4e5b-93b7-a149ed4cd571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[574754ed-9ace-4f23-9f0b-fec12e06561e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:18 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7845b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[197bf7a7-80f7-47be-8afc-4daf8a5dafa2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d0d68-08c6-471f-bf72-c60c3eb18022]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb9e02-f409-46d3-85ca-92a32a16deaf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[70002645-84bd-45ea-9d09-b2e20da0342e]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a0c31-07eb-4b91-8469-5aae30ff27da]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c47bbf-1481-4e0b-939e-870bd6e484ed]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260]
Aug 27 01:14:18 user nova-compute[73458]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:18 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a85914-b61d-4fd7-9f71-d47cdfaf40f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6925efd-6ca8-43d6-b990-9dc59b621eec]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== disconnect_volume: return (335ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:14:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:19 user nova-compute[73458]: DEBUG nova.objects.instance [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-11940b25-32e9-48e3-a05d-7d2539f3c1f3 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.927s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:19 user nova-compute[73458]: INFO nova.compute.manager [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Detaching volume cda9ab3f-de39-4ac7-a3c4-af284554208a
Aug 27 01:14:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:20 user nova-compute[73458]: INFO nova.virt.block_device [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Attempting to driver detach volume cda9ab3f-de39-4ac7-a3c4-af284554208a from mountpoint /dev/vdc
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Attempting to detach device vdc from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:20 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:20 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:14:20 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:14:20 user nova-compute[73458]:   <serial>cda9ab3f-de39-4ac7-a3c4-af284554208a</serial>
Aug 27 01:14:20 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 01:14:20 user nova-compute[73458]: </disk>
Aug 27 01:14:20 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdc from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the persistent domain config.
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:20 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:20 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:14:20 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:14:20 user nova-compute[73458]:   <serial>cda9ab3f-de39-4ac7-a3c4-af284554208a</serial>
Aug 27 01:14:20 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 01:14:20 user nova-compute[73458]: </disk>
Aug 27 01:14:20 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098860.6780233, 4b3de184-3578-4f0a-8433-9e7e1f5625f8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:14:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully detached device vdc from instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8 from the live domain config.
Aug 27 01:14:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAixXSu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:20 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12ae4e-390d-4a3b-851b-a4293e63ae91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.099s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df9a8b-49c3-4bff-9b57-8138c5d13cea]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:20 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:20 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:20 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:20 user nova-compute[73458]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a (non-flash)
Aug 27 01:14:20 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7851b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63e7471-ee12-4e68-99c2-536da40401f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd22450-f213-432a-8b97-ea057df537f8]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deee353-ad94-454c-b2ab-27ba5304f254]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:14:20 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.193s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895ec4a-949d-455b-b1b7-ec39f70279c2]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc0ae5-95de-45c8-acd5-1716f4416eeb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a727d596-0401-41b5-b5ec-73a3a19443f6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260]
Aug 27 01:14:21 user nova-compute[73458]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:21 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda9ab3f-de39-4ac7-a3c4-af284554208a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef3bed5-c000-42ba-8dbb-2fbd29a259fe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.561s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] <== disconnect_volume: return (563ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'flavor' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f1ddabd6-4cb7-4501-8dde-1eae709e9ee4 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.177s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:22 user nova-compute[73458]: INFO nova.compute.manager [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Terminating instance
Aug 27 01:14:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-unplugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] No waiting events found dispatching network-vif-unplugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-ae5128f4-961b-4323-8637-1a9d52d92997 req-f8546a8e-a3d1-4e9a-8e24-db2fe6937548 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-unplugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:14:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Instance destroyed successfully.
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lazy-loading 'resources' on Instance uuid 4b3de184-3578-4f0a-8433-9e7e1f5625f8 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-960009725',display_name='tempest-AttachVolumeTestJSON-server-960009725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-960009725',id=38,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBVeZc3qK4o/DBo0lWvTbW3aHR+eoR/fuqqR0ERjtLfcjfbKXgNi0HyV4ZTrkipEd7l0lkqczH2a+k0j7AzTy8dNqRFZh3+LqVsTHcsxWN82g4pb8yfZudxn6zneJCHgg==',key_name='tempest-keypair-1819702105',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='621fecd1a05149b98beae4e5591b71e1',ramdisk_id='',reservation_id='r-mpew16ia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1240035283',owner_user_name='tempest-AttachVolumeTestJSON-1240035283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de7db48736b94edfa58071875ce52e65',uuid=4b3de184-3578-4f0a-8433-9e7e1f5625f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converting VIF {"id": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "address": "fa:16:3e:96:e0:f9", "network": {"id": "1da765e9-ff22-4c2b-a569-e26b389d2045", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974820028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "621fecd1a05149b98beae4e5591b71e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfe353-6b", "ovs_interfaceid": "fedfe353-6b96-4dbc-971b-8a966068a4e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG os_vif [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfedfe353-6b, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:14:23 user nova-compute[73458]: INFO os_vif [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e0:f9,bridge_name='br-int',has_traffic_filtering=True,id=fedfe353-6b96-4dbc-971b-8a966068a4e2,network=Network(1da765e9-ff22-4c2b-a569-e26b389d2045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfe353-6b')
Aug 27 01:14:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Deleting instance files /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8_del
Aug 27 01:14:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Deletion of /opt/stack/data/nova/instances/4b3de184-3578-4f0a-8433-9e7e1f5625f8_del complete
Aug 27 01:14:23 user nova-compute[73458]: INFO nova.compute.manager [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 01:14:23 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:14:23 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:14:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] Acquiring lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] No waiting events found dispatching network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:14:25 user nova-compute[73458]: WARNING nova.compute.manager [req-a1726d50-6fd0-460e-b29b-54f908051312 req-f6772712-fcac-4a14-81ab-65f2e03625db service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received unexpected event network-vif-plugged-fedfe353-6b96-4dbc-971b-8a966068a4e2 for instance with vm_state active and task_state deleting.
Aug 27 01:14:25 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Took 1.59 seconds to deallocate network for instance.
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-8d01fa40-a654-4aaa-a99f-83a32ac044aa req-09373248-d50f-4180-99bf-f15e8a278a94 service nova] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Received event network-vif-deleted-fedfe353-6b96-4dbc-971b-8a966068a4e2 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:25 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Deleted allocations for instance 4b3de184-3578-4f0a-8433-9e7e1f5625f8
Aug 27 01:14:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2032e92c-7092-4ef8-88e7-91649810e2c9 tempest-AttachVolumeTestJSON-1240035283 tempest-AttachVolumeTestJSON-1240035283-project-member] Lock "4b3de184-3578-4f0a-8433-9e7e1f5625f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.015s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXwhmHqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:26 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3061565e-77fc-4b6f-a431-3e11991838df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:14:26 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e9bf39-550b-4d6a-9009-12c308c63786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0] added
Aug 27 01:14:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a65958-17f5-4cc3-a8f9-004a50c5b0e3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e394d6e6-9a0a-4b31-9a31-90d654ead911]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXwhmHqf {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TXwhmHqf" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3581bda-091a-47b6-b239-b540532997da]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TXwhmHqf'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d777451c-e147-4d50-9126-8515e63c039a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a957995-938c-47c4-8c8a-8944a5b5fcf8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:26 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:26 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6849c7-83a0-453d-8ce7-887c0700a626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260]
Aug 27 01:14:27 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[826e918a-eb89-4276-b638-dd5b9613be48]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a283b96-ebe1-44cf-b092-2221048adc8a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)
Aug 27 01:14:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de7fad7-5bd3-42a6-9bff-38724adcc346]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXwhmHqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23031653564363635', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031653564363635', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:14:28 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:28 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:14:28 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:14:28 user nova-compute[73458]:   <serial>26fcd4b2-e761-4d3b-83d4-214fa67d3db0</serial>
Aug 27 01:14:28 user nova-compute[73458]: </disk>
Aug 27 01:14:28 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] No VIF found with MAC fa:16:3e:b5:96:47, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4b59b9d7-d554-4d87-ac93-b000857ce106 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.855s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:29 user nova-compute[73458]: INFO nova.compute.manager [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Detaching volume 26fcd4b2-e761-4d3b-83d4-214fa67d3db0
Aug 27 01:14:29 user nova-compute[73458]: INFO nova.virt.block_device [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Attempting to driver detach volume 26fcd4b2-e761-4d3b-83d4-214fa67d3db0 from mountpoint /dev/vdb
Aug 27 01:14:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Attempting to detach device vdb from instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:14:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:29 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:29 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:14:29 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:14:29 user nova-compute[73458]:   <serial>26fcd4b2-e761-4d3b-83d4-214fa67d3db0</serial>
Aug 27 01:14:29 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:14:29 user nova-compute[73458]: </disk>
Aug 27 01:14:29 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 from the persistent domain config.
Aug 27 01:14:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:14:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:14:29 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:14:29 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:14:29 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:14:29 user nova-compute[73458]:   <serial>26fcd4b2-e761-4d3b-83d4-214fa67d3db0</serial>
Aug 27 01:14:29 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:14:29 user nova-compute[73458]: </disk>
Aug 27 01:14:29 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098870.3662477, 0ce1347e-2df7-4d8d-8d18-e39bf024b109 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:14:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully detached device vdb from instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 from the live domain config.
Aug 27 01:14:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TXwhmHqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:30 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f593597e-1881-49f4-a22e-bb6abab53583]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf68f5-cef4-4a41-a0ba-e43b000ce3a2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 (non-flash)
Aug 27 01:14:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7837beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c739232-44b9-4c36-90ea-43ea70f9d7c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5156e-94b4-4d3a-8855-0052d68559ce]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b398bb-a402-4a7d-bb73-de8d56fab22f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241a6d3-a245-4526-bc15-7b5c97dcc442]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3918355-85bd-484e-91a0-ff72d8bdb83d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a857cd0f-3dd3-43a6-a3b7-1d98ae938269]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260]
Aug 27 01:14:30 user nova-compute[73458]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0, portal: 172.16.0.220,3260] successful.
Aug 27 01:14:30 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26fcd4b2-e761-4d3b-83d4-214fa67d3db0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac1d74-80f2-44fb-8c62-0c6822fe117d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] <== disconnect_volume: return (269ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:14:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'flavor' on Instance uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a3f1df96-b4cd-4662-bcb6-6089a51fe731 tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.726s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:38 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098863.5902638, 4b3de184-3578-4f0a-8433-9e7e1f5625f8 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:14:38 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] VM Stopped (Lifecycle Event)
Aug 27 01:14:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-63bcd7c5-5418-4fa8-9007-299da6b3a5f7 None None] [instance: 4b3de184-3578-4f0a-8433-9e7e1f5625f8] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:14:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:14:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:14:41 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:14:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.367942810058594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 97832e51-8a29-4073-b61e-e2aa479e58c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b981719b-a3c3-41c9-bc33-44aa03774c5b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:14:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:14:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [{"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-0ce1347e-2df7-4d8d-8d18-e39bf024b109" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:14:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-changed-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Refreshing instance network info cache due to event network-changed-42d08d14-a62d-4f82-b3cd-3349fe288314. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] Acquiring lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] Acquired lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG nova.network.neutron [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Refreshing network info cache for port 42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:14:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Ignoring supplied device name: /dev/vdb
Aug 27 01:14:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:14:56 user nova-compute[73458]: INFO nova.compute.manager [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Attaching volume c7537137-be05-44ff-b4ab-f51e5cc4d9cc to /dev/vdb
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8ded7-fe34-4af1-8473-f61441146c1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b436d-4df0-45b5-af7c-b1c3c117a321]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b985ee-d4ab-4f74-965a-5a27a4bc464e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[610ed652-1789-4189-bfe9-ca8f4bc56255]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updated VIF entry in instance network info cache for port 42d08d14-a62d-4f82-b3cd-3349fe288314. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating instance_info_cache with network_info: [{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9b0362b6-44bc-47c5-9867-96f1d69020bb req-b26039fe-fd6c-4b47-86a3-47841e2c7796 service nova] Releasing lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:14:56 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:14:56 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ff6a5-86db-4c38-a9a9-e00030fcca38]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG os_brick.utils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:14:56 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating existing volume attachment record: 9153b4d1-ea5d-4ea2-af19-c8b3a6ecc762 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:14:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:14:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:14:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:14:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:14:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYTSwlHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:15:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:15:07 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:15:07 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f59a8b-3fff-4101-bfd2-f26e47a47b05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:15:07 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef3bf4-29ec-47e4-beae-887ba08c9542]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc] added
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e7415-a195-4bf5-8f73-990ca9a6d211]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeaf1b9-4bd8-4f15-a844-f8efcd2df787]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYTSwlHz {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYTSwlHz" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eebba0-eda3-41e2-b75b-017470b67d70]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYTSwlHz'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb229a-3d49-4e65-9b0d-0747ad3d3f5c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b50bc7-9137-4a14-9d26-f74c5d75381a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7185d1-7dc6-43e6-b603-0af7ebb318c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260]
Aug 27 01:15:07 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260] successful.
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5a0dee-5982-4db6-8f94-b5f76e7bf152]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b870c0-f9e2-4009-9f54-67017fdf9a2f]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:07 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:15:07 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b2baaa-37e1-4f3d-8fb5-4e00c9e015af]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:07 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYTSwlHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23337323830316262', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337323830316262', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:15:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:15:08 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:15:08 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:15:08 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:15:08 user nova-compute[73458]:   <serial>c7537137-be05-44ff-b4ab-f51e5cc4d9cc</serial>
Aug 27 01:15:08 user nova-compute[73458]: </disk>
Aug 27 01:15:08 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:15:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:15:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:15:09 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No VIF found with MAC fa:16:3e:ae:b8:cc, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:15:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7ad650dc-57fc-45c0-ae76-8274bdc67d41 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.363s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:15:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 97832e51-8a29-4073-b61e-e2aa479e58c6 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid b981719b-a3c3-41c9-bc33-44aa03774c5b {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.004s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:19 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:20 user nova-compute[73458]: INFO nova.compute.manager [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Terminating instance
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-unplugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] No waiting events found dispatching network-vif-unplugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-1765f7c9-87fc-412f-a162-243dbb5472c9 req-3133a107-1bb1-4611-b231-01cad6c1192a service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-unplugged-33066873-287c-4a85-80af-70031cb53725 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:15:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Instance destroyed successfully.
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lazy-loading 'resources' on Instance uuid 0ce1347e-2df7-4d8d-8d18-e39bf024b109 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-25034988',display_name='tempest-AttachVolumeNegativeTest-server-25034988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-25034988',id=39,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWyOajdUPOZy16xf7Yp+lSnDuvRq9bS+LBb8/EwLXujyhIlaYozc2Gn8d62kTCt2cREzrfOWkIzBuUYK25SHDsxAQfeZwy2+4WJg3/M+5oXgv7BK46uIO5CjvrBcsqscQ==',key_name='tempest-keypair-989907300',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b791d4bc10b648919b7ac2164c0b6709',ramdisk_id='',reservation_id='r-jg6dtggi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-643859675',owner_user_name='tempest-AttachVolumeNegativeTest-643859675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:12:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5706f2b84a8148fea7e3c91808d39452',uuid=0ce1347e-2df7-4d8d-8d18-e39bf024b109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converting VIF {"id": "33066873-287c-4a85-80af-70031cb53725", "address": "fa:16:3e:b5:96:47", "network": {"id": "a2daae68-0cac-4716-a500-19fc3d45326a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1808186768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b791d4bc10b648919b7ac2164c0b6709", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33066873-28", "ovs_interfaceid": "33066873-287c-4a85-80af-70031cb53725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG os_vif [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33066873-28, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:15:20 user nova-compute[73458]: INFO os_vif [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:96:47,bridge_name='br-int',has_traffic_filtering=True,id=33066873-287c-4a85-80af-70031cb53725,network=Network(a2daae68-0cac-4716-a500-19fc3d45326a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33066873-28')
Aug 27 01:15:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Deleting instance files /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109_del
Aug 27 01:15:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Deletion of /opt/stack/data/nova/instances/0ce1347e-2df7-4d8d-8d18-e39bf024b109_del complete
Aug 27 01:15:21 user nova-compute[73458]: INFO nova.compute.manager [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 01:15:21 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:15:21 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:15:21 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:15:22 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Took 1.09 seconds to deallocate network for instance.
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-3fa8a03f-dd73-4f36-a2fb-1577f8acce10 req-0a3fc662-e349-4df2-89e5-decf1a67f242 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-deleted-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:22 user nova-compute[73458]: INFO nova.compute.manager [req-3fa8a03f-dd73-4f36-a2fb-1577f8acce10 req-0a3fc662-e349-4df2-89e5-decf1a67f242 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Neutron deleted interface 33066873-287c-4a85-80af-70031cb53725; detaching it from the instance and deleting it from the info cache
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.network.neutron [req-3fa8a03f-dd73-4f36-a2fb-1577f8acce10 req-0a3fc662-e349-4df2-89e5-decf1a67f242 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-3fa8a03f-dd73-4f36-a2fb-1577f8acce10 req-0a3fc662-e349-4df2-89e5-decf1a67f242 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Detach interface failed, port_id=33066873-287c-4a85-80af-70031cb53725, reason: Instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109 could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] Acquiring lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.manager [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] No waiting events found dispatching network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:15:22 user nova-compute[73458]: WARNING nova.compute.manager [req-a9b95033-6ce2-4b5b-8aa8-f9a1b0ca6e0d req-8b4dd536-547c-4254-b4ce-effd4ddde735 service nova] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Received unexpected event network-vif-plugged-33066873-287c-4a85-80af-70031cb53725 for instance with vm_state deleted and task_state None.
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:22 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Deleted allocations for instance 0ce1347e-2df7-4d8d-8d18-e39bf024b109
Aug 27 01:15:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08c7449e-8188-4ef4-b89f-b2fa4e3c690e tempest-AttachVolumeNegativeTest-643859675 tempest-AttachVolumeNegativeTest-643859675-project-member] Lock "0ce1347e-2df7-4d8d-8d18-e39bf024b109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.566s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-changed-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Refreshing instance network info cache due to event network-changed-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] Acquiring lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] Acquired lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Refreshing network info cache for port c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updated VIF entry in instance network info cache for port c99ff0d7-82e6-46cb-a6e9-893f0a124bc4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updating instance_info_cache with network_info: [{"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:15:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6885e405-8d87-44eb-85c2-8111b5fe13aa req-61d07e61-1ab3-4900-bd7c-bd1da8ed566f service nova] Releasing lock "refresh_cache-b981719b-a3c3-41c9-bc33-44aa03774c5b" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:32 user nova-compute[73458]: INFO nova.compute.manager [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Terminating instance
Aug 27 01:15:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-unplugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] No waiting events found dispatching network-vif-unplugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-35bab97c-b9ba-4d31-98d7-be9b1126f060 req-73648199-2f54-4f1e-b6a6-8e0fc94dd69f service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-unplugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:33 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Instance destroyed successfully.
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.objects.instance [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid b981719b-a3c3-41c9-bc33-44aa03774c5b {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-784007792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-784007792',id=41,image_ref='d4193c0e-eee5-4a5b-8be4-6f0a50b5c873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhspJOCnM/1fTajvNOB1bUHEfGLc1YT0doP2/Bg090cwbfgMGq0BHvQ/gMMVsqpHBHw4f4oO38g33zctTwYgebqCehjSlSnMfxmZvx51/HoB0ebhu8zG7ufjuzWTbzCKg==',key_name='tempest-keypair-1597203146',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:14:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-ps1tdrap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1099761153',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=b981719b-a3c3-41c9-bc33-44aa03774c5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "address": "fa:16:3e:f1:d6:f8", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc99ff0d7-82", "ovs_interfaceid": "c99ff0d7-82e6-46cb-a6e9-893f0a124bc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_vif [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc99ff0d7-82, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:15:33 user nova-compute[73458]: INFO os_vif [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d6:f8,bridge_name='br-int',has_traffic_filtering=True,id=c99ff0d7-82e6-46cb-a6e9-893f0a124bc4,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc99ff0d7-82')
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dGlMiKsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:15:33 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aca8d6-7d1c-4a77-8ce4-198cf86b25cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b2170c-0e02-44aa-9f20-8e550c18dca9]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:33 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:33 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:15:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:15:33 user nova-compute[73458]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 (non-flash)
Aug 27 01:15:33 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:15:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eae0280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[881aabfc-31ec-4176-aefe-051805179c70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[226bfcab-6a99-40ba-a98e-920c0606b262]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb53d32-58a9-473b-b822-ab76c6122d95]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.070s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f86d0c-bdac-4d13-84fd-2dbe6ac51ff7]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_14df5071',) {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:15:33 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_14df5071
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b4680-040a-4940-b91c-bd385d5fb202]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a831e35-f423-4b3a-8c74-059fe3c9b4f0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[123b76af-8e0d-4c25-bbea-ee963ccb537a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260]
Aug 27 01:15:33 user nova-compute[73458]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078, portal: 172.16.0.220,3260] successful.
Aug 27 01:15:33 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12717935-deb9-4abd-8b76-11d65560a078 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a2a72a-c9ae-49cb-88f1-8bcf3082307d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (333ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:15:33 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Deleting instance files /opt/stack/data/nova/instances/b981719b-a3c3-41c9-bc33-44aa03774c5b_del
Aug 27 01:15:33 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Deletion of /opt/stack/data/nova/instances/b981719b-a3c3-41c9-bc33-44aa03774c5b_del complete
Aug 27 01:15:33 user nova-compute[73458]: INFO nova.compute.manager [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 27 01:15:33 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:15:33 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:15:34 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Took 0.86 seconds to deallocate network for instance.
Aug 27 01:15:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-4871000a-b983-4996-b28d-8609ae7bce42 req-4c3e01e6-98d7-4ffa-96d8-a813f60db2bd service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-deleted-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] Acquiring lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] No waiting events found dispatching network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:15:34 user nova-compute[73458]: WARNING nova.compute.manager [req-f1cbf9ad-3947-4657-aff9-72211f866edc req-c3cf7ae6-13d7-45f7-906c-d123a31b1ebc service nova] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Received unexpected event network-vif-plugged-c99ff0d7-82e6-46cb-a6e9-893f0a124bc4 for instance with vm_state active and task_state deleting.
Aug 27 01:15:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:35 user nova-compute[73458]: INFO nova.compute.manager [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Took 0.93 seconds to detach 1 volumes for instance.
Aug 27 01:15:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Deleting volume: 12717935-deb9-4abd-8b76-11d65560a078 {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:35 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance b981719b-a3c3-41c9-bc33-44aa03774c5b
Aug 27 01:15:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-08665557-17de-47d2-9a2a-c97809956431 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "b981719b-a3c3-41c9-bc33-44aa03774c5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.451s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:35 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098920.8898811, 0ce1347e-2df7-4d8d-8d18-e39bf024b109 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:15:35 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] VM Stopped (Lifecycle Event)
Aug 27 01:15:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-436e2b91-26a3-4489-a9e0-42ac56781f29 None None] [instance: 0ce1347e-2df7-4d8d-8d18-e39bf024b109] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:15:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:15:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:15:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:15:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.36766815185547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 97832e51-8a29-4073-b61e-e2aa479e58c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:15:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:15:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:15:46 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098933.1563778, b981719b-a3c3-41c9-bc33-44aa03774c5b => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:15:48 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] VM Stopped (Lifecycle Event)
Aug 27 01:15:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8431a3d-4c01-4690-94bc-0af55a7b2fc0 None None] [instance: b981719b-a3c3-41c9-bc33-44aa03774c5b] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:15:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating instance_info_cache with network_info: [{"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-39d37612-adc1-4157-bee5-b5b6fd73bdb6" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:15:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:15:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:15:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:16:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:21 user nova-compute[73458]: INFO nova.compute.manager [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Detaching volume c7537137-be05-44ff-b4ab-f51e5cc4d9cc
Aug 27 01:16:21 user nova-compute[73458]: INFO nova.virt.block_device [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Attempting to driver detach volume c7537137-be05-44ff-b4ab-f51e5cc4d9cc from mountpoint /dev/vdb
Aug 27 01:16:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Attempting to detach device vdb from instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:16:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:16:21 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:16:21 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:16:21 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:16:21 user nova-compute[73458]:   <serial>c7537137-be05-44ff-b4ab-f51e5cc4d9cc</serial>
Aug 27 01:16:21 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:16:21 user nova-compute[73458]: </disk>
Aug 27 01:16:21 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:16:21 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully detached device vdb from instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 from the persistent domain config.
Aug 27 01:16:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:16:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:16:21 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:16:21 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:16:21 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:16:21 user nova-compute[73458]:   <serial>c7537137-be05-44ff-b4ab-f51e5cc4d9cc</serial>
Aug 27 01:16:21 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:16:21 user nova-compute[73458]: </disk>
Aug 27 01:16:21 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:16:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693098982.1522899, 39d37612-adc1-4157-bee5-b5b6fd73bdb6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:16:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully detached device vdb from instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6 from the live domain config.
Aug 27 01:16:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYTSwlHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:16:22 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77743c-abf1-4515-81f9-f30114f94ca1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee4fd1e-a2c3-4b79-823f-eb2e5e810180]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:22 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:16:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:22 user nova-compute[73458]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc (non-flash)
Aug 27 01:16:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7851bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b22a24-251a-4c8c-8cef-2f6829187d0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b993f8-9f5d-4d7f-abc1-5f70fb58ceda]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3a93a2-f8a9-4a0d-8675-2ca2f1f55290]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f7d7d-33ad-4a27-b551-ae9e7d021a9f]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907abca-48bc-48ef-a76d-b7f11688f853]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae34d2f5-7fbf-400d-8184-354ec5987004]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260]
Aug 27 01:16:22 user nova-compute[73458]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc, portal: 172.16.0.220,3260] successful.
Aug 27 01:16:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aff75fa-a327-48db-9a92-e20e0ce975ed]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== disconnect_volume: return (280ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:16:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-73d3ab0c-2752-4d0e-87f9-d178562bafab tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.583s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:23 user nova-compute[73458]: INFO nova.compute.manager [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Terminating instance
Aug 27 01:16:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-unplugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] No waiting events found dispatching network-vif-unplugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-50ac3091-3615-49de-9d88-2859def49d05 req-786393f8-2916-4f9b-a5aa-8c60391510ef service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-unplugged-42d08d14-a62d-4f82-b3cd-3349fe288314 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:16:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Instance destroyed successfully.
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.objects.instance [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'resources' on Instance uuid 39d37612-adc1-4157-bee5-b5b6fd73bdb6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2084733235',display_name='tempest-VolumesSnapshotTestJSON-instance-2084733235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2084733235',id=40,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDLScpgw+fYw2+gg/woQEv9UtrrLI9J/3TMyjoenQCj7kW8v9subhazsHP3FZPwV2AdHghyuGKz2x75ymdDUfK+lBvQvEGCQ4GbBThmw6sIYiCYJLtxh77I8KwK+wmo1w==',key_name='tempest-keypair-499682637',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:13:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-sqk0kaht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=39d37612-adc1-4157-bee5-b5b6fd73bdb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "42d08d14-a62d-4f82-b3cd-3349fe288314", "address": "fa:16:3e:ae:b8:cc", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42d08d14-a6", "ovs_interfaceid": "42d08d14-a62d-4f82-b3cd-3349fe288314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_vif [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42d08d14-a6, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:16:24 user nova-compute[73458]: INFO os_vif [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:b8:cc,bridge_name='br-int',has_traffic_filtering=True,id=42d08d14-a62d-4f82-b3cd-3349fe288314,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42d08d14-a6')
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYTSwlHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:16:24 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7537137-be05-44ff-b4ab-f51e5cc4d9cc', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad502d77-2cea-4ff3-930d-6a43fd61205c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30de2a-4131-438c-9269-fa54748695a8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:24 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78532320>, {}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Disconnecting from: [] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== disconnect_volume: return (47ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:16:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Deleting instance files /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6_del
Aug 27 01:16:24 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Deletion of /opt/stack/data/nova/instances/39d37612-adc1-4157-bee5-b5b6fd73bdb6_del complete
Aug 27 01:16:24 user nova-compute[73458]: INFO nova.compute.manager [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 01:16:24 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:16:24 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:16:25 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Took 1.30 seconds to deallocate network for instance.
Aug 27 01:16:25 user nova-compute[73458]: WARNING nova.volume.cinder [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Attachment 9153b4d1-ea5d-4ea2-af19-c8b3a6ecc762 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9153b4d1-ea5d-4ea2-af19-c8b3a6ecc762. (HTTP 404) (Request-ID: req-ea31df00-d788-4395-979c-17cc01aa1739)
Aug 27 01:16:25 user nova-compute[73458]: INFO nova.compute.manager [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Took 0.02 seconds to detach 1 volumes for instance.
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] Acquiring lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] No waiting events found dispatching network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:25 user nova-compute[73458]: WARNING nova.compute.manager [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received unexpected event network-vif-plugged-42d08d14-a62d-4f82-b3cd-3349fe288314 for instance with vm_state deleted and task_state None.
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a7c64bf-8a16-4191-8347-85b3550596d6 req-a8d463bc-64d4-42e8-9d9a-4bacd7db4eaf service nova] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Received event network-vif-deleted-42d08d14-a62d-4f82-b3cd-3349fe288314 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:25 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Deleted allocations for instance 39d37612-adc1-4157-bee5-b5b6fd73bdb6
Aug 27 01:16:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-60ff8b4a-721f-4cee-af4a-8670bb2872f9 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "39d37612-adc1-4157-bee5-b5b6fd73bdb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:30 user nova-compute[73458]: INFO nova.compute.manager [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Terminating instance
Aug 27 01:16:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-unplugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] No waiting events found dispatching network-vif-unplugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f23da4f-6de1-4173-8f54-e7fe6ff6bc47 req-030ba7be-41dd-4022-bf37-47f5e632b90d service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-unplugged-687707d0-3599-4e1f-b18f-275cb30c6819 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:16:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Instance destroyed successfully.
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid 97832e51-8a29-4073-b61e-e2aa479e58c6 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1852700526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1852700526',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyn46HviSImPCN8HS/NvXHKiTpZ4ZpD7xP8htun+6yxPi7coft5+bCKqZfKAZbTPcPl7686dG7LrvGXOB50kbcqa2xxK9/F0l44NI0GiaDSmKoCO4iAw6yzKzZQaDIWdw==',key_name='tempest-keypair-146345837',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-df0xwzu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56a037d33b594c078bd85fa5eafed883',uuid=97832e51-8a29-4073-b61e-e2aa479e58c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "687707d0-3599-4e1f-b18f-275cb30c6819", "address": "fa:16:3e:ea:9e:87", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap687707d0-35", "ovs_interfaceid": "687707d0-3599-4e1f-b18f-275cb30c6819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_vif [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap687707d0-35, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:31 user nova-compute[73458]: INFO os_vif [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:9e:87,bridge_name='br-int',has_traffic_filtering=True,id=687707d0-3599-4e1f-b18f-275cb30c6819,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap687707d0-35')
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXDTgboW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:16:31 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[034591e3-1f23-41c9-a52e-ac0c7509d39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9678b-bf4a-48fa-9dea-fb94c2302982]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 (non-flash)
Aug 27 01:16:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eae12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da850b-21b3-4a91-a2b9-c4458cfe9c6c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[410b7588-7527-4038-9c26-3f0f53670a95]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41dcffd-f55a-493f-8cdc-06742314f700]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d77b69-2ec3-4f00-90b3-d46198e04ad6]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1522494f', '/dev/disk/by-id/scsi-1SCST_BIO1522494f-1f798b0a069d9d7a', '/dev/disk/by-id/scsi-23166373938623061') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f84b2f4-5515-4925-9c30-985b0d2904ba]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4420238-f8fd-4275-bee1-df30d14e016a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f0afaf-855a-4132-a1df-4e2077ac9c7f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260]
Aug 27 01:16:31 user nova-compute[73458]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0, portal: 172.16.0.220,3260] successful.
Aug 27 01:16:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb4ae21-4712-47d2-8c17-a502f3aae6e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d689c3-ad78-44a4-9e10-e7b6832b8c06]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (323ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:16:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Deleting instance files /opt/stack/data/nova/instances/97832e51-8a29-4073-b61e-e2aa479e58c6_del
Aug 27 01:16:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Deletion of /opt/stack/data/nova/instances/97832e51-8a29-4073-b61e-e2aa479e58c6_del complete
Aug 27 01:16:31 user nova-compute[73458]: INFO nova.compute.manager [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 27 01:16:31 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:16:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:16:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:16:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:32 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Took 0.80 seconds to deallocate network for instance.
Aug 27 01:16:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-04de81c5-d38f-4e11-93d8-9a335574a4ce req-9c96a6a2-06aa-47af-a611-3b9eaa6f43e6 service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-deleted-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] Acquiring lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] No waiting events found dispatching network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:33 user nova-compute[73458]: WARNING nova.compute.manager [req-9201dd62-e5db-40c9-ba6f-c248c87e4e87 req-219baddc-0d06-42d2-9dba-861a755635eb service nova] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Received unexpected event network-vif-plugged-687707d0-3599-4e1f-b18f-275cb30c6819 for instance with vm_state active and task_state deleting.
Aug 27 01:16:33 user nova-compute[73458]: INFO nova.compute.manager [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Took 1.02 seconds to detach 1 volumes for instance.
Aug 27 01:16:33 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Deleting volume: acb4ae21-4712-47d2-8c17-a502f3aae6e0 {{(pid=73458) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:16:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:33 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance 97832e51-8a29-4073-b61e-e2aa479e58c6
Aug 27 01:16:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2a1344dc-7a64-40bc-8ec2-38e5fc708bc1 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "97832e51-8a29-4073-b61e-e2aa479e58c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:39 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098984.1255887, 39d37612-adc1-4157-bee5-b5b6fd73bdb6 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:16:39 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] VM Stopped (Lifecycle Event)
Aug 27 01:16:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e3bf0db2-3995-482a-b01e-70634ca7d795 None None] [instance: 39d37612-adc1-4157-bee5-b5b6fd73bdb6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:16:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:16:43 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:16:43 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.382213592529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:16:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:16:45 user nova-compute[73458]: INFO nova.compute.claims [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Claim successful on node user
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:16:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.policy [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95ccde0dbb894f54a6330e858b57b882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8fa36bfafce40d2bdc855661ddd3c79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:16:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Creating image(s)
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "/opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "/opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk 1073741824" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.359s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693098991.3582475, 97832e51-8a29-4073-b61e-e2aa479e58c6 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:16:46 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] VM Stopped (Lifecycle Event)
Aug 27 01:16:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d61cff9e-1b92-4854-9560-c71321b7404a None None] [instance: 97832e51-8a29-4073-b61e-e2aa479e58c6] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Cannot resize image /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Ensure instance console log exists: /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Successfully created port: b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:16:46 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Successfully updated port: b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquired lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-changed-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Refreshing instance network info cache due to event network-changed-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] Acquiring lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:16:47 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updating instance_info_cache with network_info: [{"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Releasing lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Instance network_info: |[{"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] Acquired lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Refreshing network info cache for port b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Start _get_guest_xml network_info=[{"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:16:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:16:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1020448507',display_name='tempest-VolumesNegativeTest-instance-1020448507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1020448507',id=42,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8fa36bfafce40d2bdc855661ddd3c79',ramdisk_id='',reservation_id='r-w5quvdo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1771773228',owner_user_name='tempest-VolumesNegativeTest-1771773228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:16:46Z,user_data=None,user_id='95ccde0dbb894f54a6330e858b57b882',uuid=4b9c7070-5d15-4574-8cd4-a8c45a6053c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converting VIF {"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:16:48 user nova-compute[73458]:   <uuid>4b9c7070-5d15-4574-8cd4-a8c45a6053c4</uuid>
Aug 27 01:16:48 user nova-compute[73458]:   <name>instance-0000002a</name>
Aug 27 01:16:48 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:16:48 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:16:48 user nova-compute[73458]:   <metadata>
Aug 27 01:16:48 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:16:48 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:name>tempest-VolumesNegativeTest-instance-1020448507</nova:name>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:16:48</nova:creationTime>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:16:48 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:16:48 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:owner>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:user uuid="95ccde0dbb894f54a6330e858b57b882">tempest-VolumesNegativeTest-1771773228-project-member</nova:user>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:project uuid="b8fa36bfafce40d2bdc855661ddd3c79">tempest-VolumesNegativeTest-1771773228</nova:project>
Aug 27 01:16:48 user nova-compute[73458]:       </nova:owner>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:16:48 user nova-compute[73458]:       <nova:ports>
Aug 27 01:16:48 user nova-compute[73458]:         <nova:port uuid="b3e0648c-cb25-4c7e-a25a-09a5dc4cee67">
Aug 27 01:16:48 user nova-compute[73458]:           <nova:ip type="fixed" address="192.168.233.154" ipVersion="4"/>
Aug 27 01:16:48 user nova-compute[73458]:         </nova:port>
Aug 27 01:16:48 user nova-compute[73458]:       </nova:ports>
Aug 27 01:16:48 user nova-compute[73458]:     </nova:instance>
Aug 27 01:16:48 user nova-compute[73458]:   </metadata>
Aug 27 01:16:48 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:16:48 user nova-compute[73458]:     <system>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="serial">4b9c7070-5d15-4574-8cd4-a8c45a6053c4</entry>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="uuid">4b9c7070-5d15-4574-8cd4-a8c45a6053c4</entry>
Aug 27 01:16:48 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:16:48 user nova-compute[73458]:     </system>
Aug 27 01:16:48 user nova-compute[73458]:   </sysinfo>
Aug 27 01:16:48 user nova-compute[73458]:   <os>
Aug 27 01:16:48 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:16:48 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:16:48 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:16:48 user nova-compute[73458]:   </os>
Aug 27 01:16:48 user nova-compute[73458]:   <features>
Aug 27 01:16:48 user nova-compute[73458]:     <acpi/>
Aug 27 01:16:48 user nova-compute[73458]:     <apic/>
Aug 27 01:16:48 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:16:48 user nova-compute[73458]:   </features>
Aug 27 01:16:48 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:16:48 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:16:48 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:16:48 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:16:48 user nova-compute[73458]:   </clock>
Aug 27 01:16:48 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:16:48 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:16:48 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:16:48 user nova-compute[73458]:   </cpu>
Aug 27 01:16:48 user nova-compute[73458]:   <devices>
Aug 27 01:16:48 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:16:48 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:16:48 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk"/>
Aug 27 01:16:48 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:16:48 user nova-compute[73458]:     </disk>
Aug 27 01:16:48 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:16:48 user nova-compute[73458]:       <mac address="fa:16:3e:ad:8b:ec"/>
Aug 27 01:16:48 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:16:48 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:16:48 user nova-compute[73458]:       <target dev="tapb3e0648c-cb"/>
Aug 27 01:16:48 user nova-compute[73458]:     </interface>
Aug 27 01:16:48 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:16:48 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/console.log" append="off"/>
Aug 27 01:16:48 user nova-compute[73458]:     </serial>
Aug 27 01:16:48 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:16:48 user nova-compute[73458]:     <video>
Aug 27 01:16:48 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:16:48 user nova-compute[73458]:     </video>
Aug 27 01:16:48 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:16:48 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:16:48 user nova-compute[73458]:     </rng>
Aug 27 01:16:48 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:16:48 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:16:48 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:16:48 user nova-compute[73458]:     </memballoon>
Aug 27 01:16:48 user nova-compute[73458]:   </devices>
Aug 27 01:16:48 user nova-compute[73458]: </domain>
Aug 27 01:16:48 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1020448507',display_name='tempest-VolumesNegativeTest-instance-1020448507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1020448507',id=42,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8fa36bfafce40d2bdc855661ddd3c79',ramdisk_id='',reservation_id='r-w5quvdo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1771773228',owner_user_name='tempest-VolumesNegativeTest-1771773228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:16:46Z,user_data=None,user_id='95ccde0dbb894f54a6330e858b57b882',uuid=4b9c7070-5d15-4574-8cd4-a8c45a6053c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converting VIF {"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG os_vif [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3e0648c-cb, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3e0648c-cb, col_values=(('external_ids', {'iface-id': 'b3e0648c-cb25-4c7e-a25a-09a5dc4cee67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:8b:ec', 'vm-uuid': '4b9c7070-5d15-4574-8cd4-a8c45a6053c4'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:48 user nova-compute[73458]: INFO os_vif [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb')
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] No VIF found with MAC fa:16:3e:ad:8b:ec, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updated VIF entry in instance network info cache for port b3e0648c-cb25-4c7e-a25a-09a5dc4cee67. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updating instance_info_cache with network_info: [{"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:16:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ceefec61-92c1-42b6-be41-bb35be3730c3 req-bf543d32-15ad-4f68-b3ef-620c2dc75a45 service nova] Releasing lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:16:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:50 user nova-compute[73458]: WARNING nova.compute.manager [req-8550ae73-b212-4334-8e45-caf336f0a5a8 req-bca18faf-182c-4b96-bf9c-3a038e1da20c service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received unexpected event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with vm_state building and task_state spawning.
Aug 27 01:16:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:16:52 user nova-compute[73458]: WARNING nova.compute.manager [req-794075cf-f994-444f-9a15-7ee8e17932fd req-a905059b-6d82-4038-b96f-4b0c920f7878 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received unexpected event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with vm_state building and task_state spawning.
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099012.278515, 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] VM Resumed (Lifecycle Event)
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Instance spawned successfully.
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099012.279795, 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] VM Started (Lifecycle Event)
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 27 01:16:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:16:52 user nova-compute[73458]: INFO nova.compute.manager [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Took 7.38 seconds to build instance.
Aug 27 01:16:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f980f408-7cc1-4967-9845-91e554b0ae9a tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.484s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:16:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:16:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:13 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:17:13 user nova-compute[73458]: INFO nova.compute.claims [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Claim successful on node user
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:17:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.policy [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b6c0a31ff2f452dbd1d22ef6f3e8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a2616fd21b4ca583aaf00b569d1242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:17:14 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Creating image(s)
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "/opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "/opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.197s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.200s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk 1073741824" returned: 0 in 0.071s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Successfully created port: 7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.190s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Cannot resize image /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Ensure instance console log exists: /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Successfully updated port: 7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquired lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-changed-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.compute.manager [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Refreshing instance network info cache due to event network-changed-7e2f437e-7d65-46dd-8ebf-bf058641ada4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] Acquiring lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updating instance_info_cache with network_info: [{"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Releasing lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Instance network_info: |[{"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] Acquired lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.neutron [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Refreshing network info cache for port 7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Start _get_guest_xml network_info=[{"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:17:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:16 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102225652',display_name='tempest-VolumesActionsTest-instance-1102225652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102225652',id=43,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-lo3h0zfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:14Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=ff905ded-7779-41e4-8d8c-c85944f554dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lazy-loading 'pci_devices' on Instance uuid ff905ded-7779-41e4-8d8c-c85944f554dc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:17:16 user nova-compute[73458]:   <uuid>ff905ded-7779-41e4-8d8c-c85944f554dc</uuid>
Aug 27 01:17:16 user nova-compute[73458]:   <name>instance-0000002b</name>
Aug 27 01:17:16 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:17:16 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:17:16 user nova-compute[73458]:   <metadata>
Aug 27 01:17:16 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:17:16 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:name>tempest-VolumesActionsTest-instance-1102225652</nova:name>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:17:16</nova:creationTime>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:17:16 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:17:16 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:owner>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:user uuid="4b6c0a31ff2f452dbd1d22ef6f3e8a82">tempest-VolumesActionsTest-1585999825-project-member</nova:user>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:project uuid="d6a2616fd21b4ca583aaf00b569d1242">tempest-VolumesActionsTest-1585999825</nova:project>
Aug 27 01:17:16 user nova-compute[73458]:       </nova:owner>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:17:16 user nova-compute[73458]:       <nova:ports>
Aug 27 01:17:16 user nova-compute[73458]:         <nova:port uuid="7e2f437e-7d65-46dd-8ebf-bf058641ada4">
Aug 27 01:17:16 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 01:17:16 user nova-compute[73458]:         </nova:port>
Aug 27 01:17:16 user nova-compute[73458]:       </nova:ports>
Aug 27 01:17:16 user nova-compute[73458]:     </nova:instance>
Aug 27 01:17:16 user nova-compute[73458]:   </metadata>
Aug 27 01:17:16 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:17:16 user nova-compute[73458]:     <system>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="serial">ff905ded-7779-41e4-8d8c-c85944f554dc</entry>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="uuid">ff905ded-7779-41e4-8d8c-c85944f554dc</entry>
Aug 27 01:17:16 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:17:16 user nova-compute[73458]:     </system>
Aug 27 01:17:16 user nova-compute[73458]:   </sysinfo>
Aug 27 01:17:16 user nova-compute[73458]:   <os>
Aug 27 01:17:16 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:17:16 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:17:16 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:17:16 user nova-compute[73458]:   </os>
Aug 27 01:17:16 user nova-compute[73458]:   <features>
Aug 27 01:17:16 user nova-compute[73458]:     <acpi/>
Aug 27 01:17:16 user nova-compute[73458]:     <apic/>
Aug 27 01:17:16 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:17:16 user nova-compute[73458]:   </features>
Aug 27 01:17:16 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:17:16 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:17:16 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:17:16 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:17:16 user nova-compute[73458]:   </clock>
Aug 27 01:17:16 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:17:16 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:17:16 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:17:16 user nova-compute[73458]:   </cpu>
Aug 27 01:17:16 user nova-compute[73458]:   <devices>
Aug 27 01:17:16 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:17:16 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:17:16 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk"/>
Aug 27 01:17:16 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:17:16 user nova-compute[73458]:     </disk>
Aug 27 01:17:16 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:17:16 user nova-compute[73458]:       <mac address="fa:16:3e:fc:32:c8"/>
Aug 27 01:17:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:16 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:17:16 user nova-compute[73458]:       <target dev="tap7e2f437e-7d"/>
Aug 27 01:17:16 user nova-compute[73458]:     </interface>
Aug 27 01:17:16 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:17:16 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/console.log" append="off"/>
Aug 27 01:17:16 user nova-compute[73458]:     </serial>
Aug 27 01:17:16 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:17:16 user nova-compute[73458]:     <video>
Aug 27 01:17:16 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:16 user nova-compute[73458]:     </video>
Aug 27 01:17:16 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:17:16 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:17:16 user nova-compute[73458]:     </rng>
Aug 27 01:17:16 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:17:16 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:17:16 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:17:16 user nova-compute[73458]:     </memballoon>
Aug 27 01:17:16 user nova-compute[73458]:   </devices>
Aug 27 01:17:16 user nova-compute[73458]: </domain>
Aug 27 01:17:16 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102225652',display_name='tempest-VolumesActionsTest-instance-1102225652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102225652',id=43,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-lo3h0zfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:14Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=ff905ded-7779-41e4-8d8c-c85944f554dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG os_vif [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e2f437e-7d, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e2f437e-7d, col_values=(('external_ids', {'iface-id': '7e2f437e-7d65-46dd-8ebf-bf058641ada4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:32:c8', 'vm-uuid': 'ff905ded-7779-41e4-8d8c-c85944f554dc'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:17:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:16 user nova-compute[73458]: INFO os_vif [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d')
Aug 27 01:17:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:17:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] No VIF found with MAC fa:16:3e:fc:32:c8, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:17:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updated VIF entry in instance network info cache for port 7e2f437e-7d65-46dd-8ebf-bf058641ada4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:17:17 user nova-compute[73458]: DEBUG nova.network.neutron [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updating instance_info_cache with network_info: [{"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-1595f77d-61ce-4606-a8bb-87927955031a req-b6cb9280-a897-4aa8-8106-0b8979d9b87c service nova] Releasing lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:18 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] No waiting events found dispatching network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:18 user nova-compute[73458]: WARNING nova.compute.manager [req-7f157687-f4dd-4acc-853d-8eeb7761bf8f req-f8e4c305-c8bd-4e4a-9aa0-fb010ece2d82 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received unexpected event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 for instance with vm_state building and task_state spawning.
Aug 27 01:17:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099040.5733683, ff905ded-7779-41e4-8d8c-c85944f554dc => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] VM Resumed (Lifecycle Event)
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Instance spawned successfully.
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099040.5745268, ff905ded-7779-41e4-8d8c-c85944f554dc => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] VM Started (Lifecycle Event)
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] No waiting events found dispatching network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:20 user nova-compute[73458]: WARNING nova.compute.manager [req-21a0150b-e7aa-4f90-bc0e-bbd1a8e5aba3 req-b807cd89-a89a-4c09-b65c-b40d263dca0b service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received unexpected event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 for instance with vm_state building and task_state spawning.
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 27 01:17:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:20 user nova-compute[73458]: INFO nova.compute.manager [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Took 6.99 seconds to build instance.
Aug 27 01:17:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-9e48d545-1c16-4b6b-a1c4-3bf8767d6dcb tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.101s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:17:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:17:29 user nova-compute[73458]: INFO nova.compute.claims [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Claim successful on node user
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:17:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.policy [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff08ca65744a428dad703efc34ba6399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb884168eb4148e19e429673ce353a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:17:29 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Creating image(s)
Aug 27 01:17:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "/opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "/opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "/opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk 1073741824" returned: 0 in 0.056s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Successfully created port: ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Cannot resize image /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Ensure instance console log exists: /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Successfully updated port: ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquired lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-changed-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Refreshing instance network info cache due to event network-changed-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] Acquiring lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.neutron [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Releasing lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Instance network_info: |[{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] Acquired lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Refreshing network info cache for port ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Start _get_guest_xml network_info=[{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:17:31 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:31 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1351340155',display_name='tempest-TestServerVolumeAttachmentScenario-server-1351340155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1351340155',id=44,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgWgmrY3XxXzPOZqCxaGqJbpzWlkRoipez7UPYC/Hr9R8/bfNM6/ksuKqakKQlCuD95nGV8J4r5UyBd2h0l7PSGll6WYkii5V7uFGqzMTOe2VyiAP9+20MnIugCK4uG1A==',key_name='tempest-keypair-1447603292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb884168eb4148e19e429673ce353a7c',ramdisk_id='',reservation_id='r-4g67k6g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-666317724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-666317724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff08ca65744a428dad703efc34ba6399',uuid=3059135e-0b8d-4450-ae5a-48bdd15128ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converting VIF {"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'pci_devices' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:17:31 user nova-compute[73458]:   <uuid>3059135e-0b8d-4450-ae5a-48bdd15128ba</uuid>
Aug 27 01:17:31 user nova-compute[73458]:   <name>instance-0000002c</name>
Aug 27 01:17:31 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:17:31 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:17:31 user nova-compute[73458]:   <metadata>
Aug 27 01:17:31 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:17:31 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1351340155</nova:name>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:17:31</nova:creationTime>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:17:31 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:17:31 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:owner>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:user uuid="ff08ca65744a428dad703efc34ba6399">tempest-TestServerVolumeAttachmentScenario-666317724-project-member</nova:user>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:project uuid="cb884168eb4148e19e429673ce353a7c">tempest-TestServerVolumeAttachmentScenario-666317724</nova:project>
Aug 27 01:17:31 user nova-compute[73458]:       </nova:owner>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:17:31 user nova-compute[73458]:       <nova:ports>
Aug 27 01:17:31 user nova-compute[73458]:         <nova:port uuid="ab32b8a7-6c46-4b89-9137-cd7f5ca86d75">
Aug 27 01:17:31 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:17:31 user nova-compute[73458]:         </nova:port>
Aug 27 01:17:31 user nova-compute[73458]:       </nova:ports>
Aug 27 01:17:31 user nova-compute[73458]:     </nova:instance>
Aug 27 01:17:31 user nova-compute[73458]:   </metadata>
Aug 27 01:17:31 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:17:31 user nova-compute[73458]:     <system>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="serial">3059135e-0b8d-4450-ae5a-48bdd15128ba</entry>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="uuid">3059135e-0b8d-4450-ae5a-48bdd15128ba</entry>
Aug 27 01:17:31 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:17:31 user nova-compute[73458]:     </system>
Aug 27 01:17:31 user nova-compute[73458]:   </sysinfo>
Aug 27 01:17:31 user nova-compute[73458]:   <os>
Aug 27 01:17:31 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:17:31 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:17:31 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:17:31 user nova-compute[73458]:   </os>
Aug 27 01:17:31 user nova-compute[73458]:   <features>
Aug 27 01:17:31 user nova-compute[73458]:     <acpi/>
Aug 27 01:17:31 user nova-compute[73458]:     <apic/>
Aug 27 01:17:31 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:17:31 user nova-compute[73458]:   </features>
Aug 27 01:17:31 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:17:31 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:17:31 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:17:31 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:17:31 user nova-compute[73458]:   </clock>
Aug 27 01:17:31 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:17:31 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:17:31 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:17:31 user nova-compute[73458]:   </cpu>
Aug 27 01:17:31 user nova-compute[73458]:   <devices>
Aug 27 01:17:31 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:17:31 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:17:31 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk"/>
Aug 27 01:17:31 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:17:31 user nova-compute[73458]:     </disk>
Aug 27 01:17:31 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:17:31 user nova-compute[73458]:       <mac address="fa:16:3e:18:7e:0e"/>
Aug 27 01:17:31 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:31 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:17:31 user nova-compute[73458]:       <target dev="tapab32b8a7-6c"/>
Aug 27 01:17:31 user nova-compute[73458]:     </interface>
Aug 27 01:17:31 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:17:31 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/console.log" append="off"/>
Aug 27 01:17:31 user nova-compute[73458]:     </serial>
Aug 27 01:17:31 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:17:31 user nova-compute[73458]:     <video>
Aug 27 01:17:31 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:31 user nova-compute[73458]:     </video>
Aug 27 01:17:31 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:17:31 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:17:31 user nova-compute[73458]:     </rng>
Aug 27 01:17:31 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:17:31 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:17:31 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:17:31 user nova-compute[73458]:     </memballoon>
Aug 27 01:17:31 user nova-compute[73458]:   </devices>
Aug 27 01:17:31 user nova-compute[73458]: </domain>
Aug 27 01:17:31 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1351340155',display_name='tempest-TestServerVolumeAttachmentScenario-server-1351340155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1351340155',id=44,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgWgmrY3XxXzPOZqCxaGqJbpzWlkRoipez7UPYC/Hr9R8/bfNM6/ksuKqakKQlCuD95nGV8J4r5UyBd2h0l7PSGll6WYkii5V7uFGqzMTOe2VyiAP9+20MnIugCK4uG1A==',key_name='tempest-keypair-1447603292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb884168eb4148e19e429673ce353a7c',ramdisk_id='',reservation_id='r-4g67k6g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-666317724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-666317724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff08ca65744a428dad703efc34ba6399',uuid=3059135e-0b8d-4450-ae5a-48bdd15128ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converting VIF {"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG os_vif [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab32b8a7-6c, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab32b8a7-6c, col_values=(('external_ids', {'iface-id': 'ab32b8a7-6c46-4b89-9137-cd7f5ca86d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:7e:0e', 'vm-uuid': '3059135e-0b8d-4450-ae5a-48bdd15128ba'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:31 user nova-compute[73458]: INFO os_vif [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c')
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:17:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No VIF found with MAC fa:16:3e:18:7e:0e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:17:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updated VIF entry in instance network info cache for port ab32b8a7-6c46-4b89-9137-cd7f5ca86d75. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:17:32 user nova-compute[73458]: DEBUG nova.network.neutron [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-03b3c6e9-47be-4eb6-94e5-84ac226edd2d req-3187685c-d77b-48be-9c4f-37264b8d0f1f service nova] Releasing lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] No waiting events found dispatching network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:33 user nova-compute[73458]: WARNING nova.compute.manager [req-6488ab8a-0cfa-4e17-8b2c-b00071cafff5 req-a7aaa930-321f-40d3-9991-1fa0b50e048c service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received unexpected event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 for instance with vm_state building and task_state spawning.
Aug 27 01:17:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] No waiting events found dispatching network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:35 user nova-compute[73458]: WARNING nova.compute.manager [req-dffd181c-39f5-4f8c-a82d-9bb780eb589f req-a183ee94-b930-47d8-887e-c0ae08cc72ea service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received unexpected event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 for instance with vm_state building and task_state spawning.
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099055.725773, 3059135e-0b8d-4450-ae5a-48bdd15128ba => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] VM Resumed (Lifecycle Event)
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Instance spawned successfully.
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099055.7274008, 3059135e-0b8d-4450-ae5a-48bdd15128ba => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] VM Started (Lifecycle Event)
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 27 01:17:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:35 user nova-compute[73458]: INFO nova.compute.manager [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Took 6.99 seconds to build instance.
Aug 27 01:17:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-37e5bf97-bfad-4641-a155-b75897b155cd tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.094s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:37 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:17:37 user nova-compute[73458]: INFO nova.compute.claims [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Claim successful on node user
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:17:38 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:17:38 user nova-compute[73458]: INFO nova.virt.block_device [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Booting with volume 1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 at /dev/vda
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.policy [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.utils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a212b79-ef5a-4625-8aa6-b15514219381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec61ec7-6320-4627-8b87-4f6e1d438a3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b958e9-15ba-4215-b927-523b8dc1c169]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fdec96-51e3-47ba-898a-b50fd7e15243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:17:38 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:17:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7170805f-a606-4baf-b467-2d8d7a24ea77]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG os_brick.utils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:17:38 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updating existing volume attachment record: f3f9bb3e-85fe-41cd-8831-53852a576128 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Successfully created port: a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Successfully updated port: a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-changed-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Refreshing instance network info cache due to event network-changed-a8813fcf-76eb-4bb1-aecd-a96b24363a03. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] Acquiring lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG nova.network.neutron [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updating instance_info_cache with network_info: [{"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Instance network_info: |[{"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] Acquired lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Refreshing network info cache for port a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updated VIF entry in instance network info cache for port a8813fcf-76eb-4bb1-aecd-a96b24363a03. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updating instance_info_cache with network_info: [{"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-929ba5dc-218b-4586-9e15-d4f101c296c5 req-55ec1bf6-6b7c-42a9-8400-4fa179d98747 service nova] Releasing lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:44 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=25.318801879882812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance ff905ded-7779-41e4-8d8c-c85944f554dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3059135e-0b8d-4450-ae5a-48bdd15128ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:17:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:17:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Creating image(s)
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Ensure instance console log exists: /opt/stack/data/nova/instances/dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Start _get_guest_xml network_info=[{"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad', 'attached_at': '', 'detached_at': '', 'volume_id': '1df90b5a-c563-44a4-bcb5-c5a2eb63ace7', 'serial': '1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'f3f9bb3e-85fe-41cd-8831-53852a576128', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:17:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:17:49 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:17:49 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:17:49 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7930eb-d589-45f2-9e4b-229c8acc0821]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:17:49 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0aa8f-95dd-4efe-a05e-bd60ccbbe833]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7] added
Aug 27 01:17:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79afe0-322f-4c27-9fc7-fc9639d07db6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c9a1b1-4505-4697-ab81-889fc5d11326]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVqGxUim {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVqGxUim" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30311a5-4d03-4a28-b44d-08bff95edf72]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVqGxUim'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63360858-d727-418a-bf7f-f4cdb4cbf4f4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0f96b-ae2c-4670-bec4-d94de55d44de]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:17:49 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:17:49 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:17:49 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:17:49 user nova-compute[73458]: 
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aaf6e6-934b-4778-934c-811e04103a67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]
Aug 27 01:17:49 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.
Aug 27 01:17:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e469526-09e4-4027-a9ea-336ccce15d35]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cbbb23-7d6d-4098-8499-7b9710daa833]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:17:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:17:49 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3276284-0869-4590-85d7-486d3057d76e]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:17:49 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23934323439656138', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:17:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934323439656138', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-145749021',display_name='tempest-TestVolumeBootPattern-server-145749021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-145749021',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-90iqplmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:38Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:17:51 user nova-compute[73458]:   <uuid>dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad</uuid>
Aug 27 01:17:51 user nova-compute[73458]:   <name>instance-0000002d</name>
Aug 27 01:17:51 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:17:51 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:17:51 user nova-compute[73458]:   <metadata>
Aug 27 01:17:51 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:17:51 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:17:51 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-server-145749021</nova:name>
Aug 27 01:17:51 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:17:49</nova:creationTime>
Aug 27 01:17:51 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:17:51 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:17:51 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:17:51 user nova-compute[73458]:       <nova:owner>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:17:51 user nova-compute[73458]:       </nova:owner>
Aug 27 01:17:51 user nova-compute[73458]:       <nova:ports>
Aug 27 01:17:51 user nova-compute[73458]:         <nova:port uuid="a8813fcf-76eb-4bb1-aecd-a96b24363a03">
Aug 27 01:17:51 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:17:51 user nova-compute[73458]:         </nova:port>
Aug 27 01:17:51 user nova-compute[73458]:       </nova:ports>
Aug 27 01:17:51 user nova-compute[73458]:     </nova:instance>
Aug 27 01:17:51 user nova-compute[73458]:   </metadata>
Aug 27 01:17:51 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:17:51 user nova-compute[73458]:     <system>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="serial">dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad</entry>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="uuid">dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad</entry>
Aug 27 01:17:51 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:17:51 user nova-compute[73458]:     </system>
Aug 27 01:17:51 user nova-compute[73458]:   </sysinfo>
Aug 27 01:17:51 user nova-compute[73458]:   <os>
Aug 27 01:17:51 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:17:51 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:17:51 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:17:51 user nova-compute[73458]:   </os>
Aug 27 01:17:51 user nova-compute[73458]:   <features>
Aug 27 01:17:51 user nova-compute[73458]:     <acpi/>
Aug 27 01:17:51 user nova-compute[73458]:     <apic/>
Aug 27 01:17:51 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:17:51 user nova-compute[73458]:   </features>
Aug 27 01:17:51 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:17:51 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:17:51 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:17:51 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:17:51 user nova-compute[73458]:   </clock>
Aug 27 01:17:51 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:17:51 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:17:51 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:17:51 user nova-compute[73458]:   </cpu>
Aug 27 01:17:51 user nova-compute[73458]:   <devices>
Aug 27 01:17:51 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:17:51 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:17:51 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:17:51 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:17:51 user nova-compute[73458]:       <serial>1df90b5a-c563-44a4-bcb5-c5a2eb63ace7</serial>
Aug 27 01:17:51 user nova-compute[73458]:     </disk>
Aug 27 01:17:51 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:17:51 user nova-compute[73458]:       <mac address="fa:16:3e:f5:ba:e3"/>
Aug 27 01:17:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:51 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:17:51 user nova-compute[73458]:       <target dev="tapa8813fcf-76"/>
Aug 27 01:17:51 user nova-compute[73458]:     </interface>
Aug 27 01:17:51 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:17:51 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad/console.log" append="off"/>
Aug 27 01:17:51 user nova-compute[73458]:     </serial>
Aug 27 01:17:51 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:17:51 user nova-compute[73458]:     <video>
Aug 27 01:17:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:51 user nova-compute[73458]:     </video>
Aug 27 01:17:51 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:17:51 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:17:51 user nova-compute[73458]:     </rng>
Aug 27 01:17:51 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:17:51 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:17:51 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:17:51 user nova-compute[73458]:     </memballoon>
Aug 27 01:17:51 user nova-compute[73458]:   </devices>
Aug 27 01:17:51 user nova-compute[73458]: </domain>
Aug 27 01:17:51 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-145749021',display_name='tempest-TestVolumeBootPattern-server-145749021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-145749021',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-90iqplmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:38Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG os_vif [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8813fcf-76, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8813fcf-76, col_values=(('external_ids', {'iface-id': 'a8813fcf-76eb-4bb1-aecd-a96b24363a03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ba:e3', 'vm-uuid': 'dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:51 user nova-compute[73458]: INFO os_vif [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76')
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:f5:ba:e3, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:17:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updating instance_info_cache with network_info: [{"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-4b9c7070-5d15-4574-8cd4-a8c45a6053c4" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:52 user nova-compute[73458]: DEBUG nova.compute.manager [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] No waiting events found dispatching network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:52 user nova-compute[73458]: WARNING nova.compute.manager [req-05397fbd-f434-4eae-b7bf-a63f4dc06a6c req-8e0b112c-e1ee-414d-872e-11fd29400262 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received unexpected event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 for instance with vm_state building and task_state spawning.
Aug 27 01:17:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:17:53 user nova-compute[73458]: INFO nova.compute.claims [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Claim successful on node user
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:17:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:17:53 user nova-compute[73458]: DEBUG nova.policy [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e8655de65e14eedb2eb239b20fe697f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdaf1e6e531a4d53a6f275560bbb93a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Creating image(s)
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "/opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "/opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "/opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.192s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099074.5534596, dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] VM Resumed (Lifecycle Event)
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Instance spawned successfully.
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk 1073741824" returned: 0 in 0.073s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099074.5551124, dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] VM Started (Lifecycle Event)
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Successfully created port: 6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.compute.manager [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] No waiting events found dispatching network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:54 user nova-compute[73458]: WARNING nova.compute.manager [req-adb72c0f-6a25-45cd-96aa-136b631fa8c7 req-74523443-3c75-4465-92cc-596fc06edb82 service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received unexpected event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 for instance with vm_state building and task_state spawning.
Aug 27 01:17:54 user nova-compute[73458]: INFO nova.compute.manager [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Took 17.09 seconds to build instance.
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ce7a067-55af-403f-82fd-0dbbfc9f7a68 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.213s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Cannot resize image /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Ensure instance console log exists: /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Successfully updated port: 6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:17:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquired lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:17:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updating instance_info_cache with network_info: [{"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Releasing lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Instance network_info: |[{"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Start _get_guest_xml network_info=[{"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:17:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1659119290',display_name='tempest-VolumesSnapshotTestJSON-instance-1659119290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1659119290',id=46,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKl6N05OnOACUw6FD5EEVQ4ccfVLaJ13NthpuplsOYDcstpvlaaUhOtgXFMwz3TbFer4/HWYaERxa+IVjpDg/yQTwLflVu+5HFr1+LQ43CAX1q/O9lCl/nryKCvVrdgTg==',key_name='tempest-keypair-887399242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-i0zj6sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=2db50725-3497-4a96-a23f-eee5ab7c46fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.objects.instance [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'pci_devices' on Instance uuid 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:17:56 user nova-compute[73458]:   <uuid>2db50725-3497-4a96-a23f-eee5ab7c46fe</uuid>
Aug 27 01:17:56 user nova-compute[73458]:   <name>instance-0000002e</name>
Aug 27 01:17:56 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:17:56 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:17:56 user nova-compute[73458]:   <metadata>
Aug 27 01:17:56 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:17:56 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1659119290</nova:name>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:17:56</nova:creationTime>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:17:56 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:17:56 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:owner>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:user uuid="9e8655de65e14eedb2eb239b20fe697f">tempest-VolumesSnapshotTestJSON-677137363-project-member</nova:user>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:project uuid="bdaf1e6e531a4d53a6f275560bbb93a0">tempest-VolumesSnapshotTestJSON-677137363</nova:project>
Aug 27 01:17:56 user nova-compute[73458]:       </nova:owner>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:17:56 user nova-compute[73458]:       <nova:ports>
Aug 27 01:17:56 user nova-compute[73458]:         <nova:port uuid="6e804a70-676c-4404-ba0b-8129a350d3d4">
Aug 27 01:17:56 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 01:17:56 user nova-compute[73458]:         </nova:port>
Aug 27 01:17:56 user nova-compute[73458]:       </nova:ports>
Aug 27 01:17:56 user nova-compute[73458]:     </nova:instance>
Aug 27 01:17:56 user nova-compute[73458]:   </metadata>
Aug 27 01:17:56 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:17:56 user nova-compute[73458]:     <system>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="serial">2db50725-3497-4a96-a23f-eee5ab7c46fe</entry>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="uuid">2db50725-3497-4a96-a23f-eee5ab7c46fe</entry>
Aug 27 01:17:56 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:17:56 user nova-compute[73458]:     </system>
Aug 27 01:17:56 user nova-compute[73458]:   </sysinfo>
Aug 27 01:17:56 user nova-compute[73458]:   <os>
Aug 27 01:17:56 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:17:56 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:17:56 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:17:56 user nova-compute[73458]:   </os>
Aug 27 01:17:56 user nova-compute[73458]:   <features>
Aug 27 01:17:56 user nova-compute[73458]:     <acpi/>
Aug 27 01:17:56 user nova-compute[73458]:     <apic/>
Aug 27 01:17:56 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:17:56 user nova-compute[73458]:   </features>
Aug 27 01:17:56 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:17:56 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:17:56 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:17:56 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:17:56 user nova-compute[73458]:   </clock>
Aug 27 01:17:56 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:17:56 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:17:56 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:17:56 user nova-compute[73458]:   </cpu>
Aug 27 01:17:56 user nova-compute[73458]:   <devices>
Aug 27 01:17:56 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:17:56 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:17:56 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk"/>
Aug 27 01:17:56 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:17:56 user nova-compute[73458]:     </disk>
Aug 27 01:17:56 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:17:56 user nova-compute[73458]:       <mac address="fa:16:3e:bc:d4:58"/>
Aug 27 01:17:56 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:56 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:17:56 user nova-compute[73458]:       <target dev="tap6e804a70-67"/>
Aug 27 01:17:56 user nova-compute[73458]:     </interface>
Aug 27 01:17:56 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:17:56 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/console.log" append="off"/>
Aug 27 01:17:56 user nova-compute[73458]:     </serial>
Aug 27 01:17:56 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:17:56 user nova-compute[73458]:     <video>
Aug 27 01:17:56 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:17:56 user nova-compute[73458]:     </video>
Aug 27 01:17:56 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:17:56 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:17:56 user nova-compute[73458]:     </rng>
Aug 27 01:17:56 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:17:56 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:17:56 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:17:56 user nova-compute[73458]:     </memballoon>
Aug 27 01:17:56 user nova-compute[73458]:   </devices>
Aug 27 01:17:56 user nova-compute[73458]: </domain>
Aug 27 01:17:56 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1659119290',display_name='tempest-VolumesSnapshotTestJSON-instance-1659119290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1659119290',id=46,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKl6N05OnOACUw6FD5EEVQ4ccfVLaJ13NthpuplsOYDcstpvlaaUhOtgXFMwz3TbFer4/HWYaERxa+IVjpDg/yQTwLflVu+5HFr1+LQ43CAX1q/O9lCl/nryKCvVrdgTg==',key_name='tempest-keypair-887399242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-i0zj6sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:17:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=2db50725-3497-4a96-a23f-eee5ab7c46fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG os_vif [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e804a70-67, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e804a70-67, col_values=(('external_ids', {'iface-id': '6e804a70-676c-4404-ba0b-8129a350d3d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d4:58', 'vm-uuid': '2db50725-3497-4a96-a23f-eee5ab7c46fe'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:56 user nova-compute[73458]: INFO os_vif [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67')
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No VIF found with MAC fa:16:3e:bc:d4:58, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-changed-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Refreshing instance network info cache due to event network-changed-6e804a70-676c-4404-ba0b-8129a350d3d4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] Acquiring lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] Acquired lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:17:56 user nova-compute[73458]: DEBUG nova.network.neutron [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Refreshing network info cache for port 6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updated VIF entry in instance network info cache for port 6e804a70-676c-4404-ba0b-8129a350d3d4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updating instance_info_cache with network_info: [{"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6248b247-b205-4cdc-baeb-c0976ff136f6 req-d5f89c29-734f-42fd-83eb-b2509bdc6411 service nova] Releasing lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:57 user nova-compute[73458]: DEBUG nova.compute.manager [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:57 user nova-compute[73458]: WARNING nova.compute.manager [req-5c071ca3-2a5b-46bb-beee-c861337b661a req-30959d4b-aa99-47bb-ac59-a394adf0dc0b service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received unexpected event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with vm_state building and task_state spawning.
Aug 27 01:17:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099079.7840035, 2db50725-3497-4a96-a23f-eee5ab7c46fe => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] VM Resumed (Lifecycle Event)
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Instance spawned successfully.
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099079.786033, 2db50725-3497-4a96-a23f-eee5ab7c46fe => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] VM Started (Lifecycle Event)
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:17:59 user nova-compute[73458]: WARNING nova.compute.manager [req-d7cd270b-1cf2-4423-a433-6cbe51e3b242 req-944d00d0-8343-496b-92a4-ccaa4539f75c service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received unexpected event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with vm_state building and task_state spawning.
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 27 01:17:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:17:59 user nova-compute[73458]: INFO nova.compute.manager [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Took 6.52 seconds to build instance.
Aug 27 01:18:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-14a6314f-e011-47fd-b206-2fda872f72d7 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.616s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:35 user nova-compute[73458]: INFO nova.compute.manager [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Terminating instance
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-unplugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-unplugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.compute.manager [req-b1e93bb2-4fd3-42b1-b4e7-fbe0d722f9cf req-50998672-1f16-4eb3-9a30-812d87bbf2e8 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-unplugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Instance destroyed successfully.
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lazy-loading 'resources' on Instance uuid 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:16:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1020448507',display_name='tempest-VolumesNegativeTest-instance-1020448507',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1020448507',id=42,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8fa36bfafce40d2bdc855661ddd3c79',ramdisk_id='',reservation_id='r-w5quvdo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1771773228',owner_user_name='tempest-VolumesNegativeTest-1771773228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:16:52Z,user_data=None,user_id='95ccde0dbb894f54a6330e858b57b882',uuid=4b9c7070-5d15-4574-8cd4-a8c45a6053c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converting VIF {"id": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "address": "fa:16:3e:ad:8b:ec", "network": {"id": "c9a6a52c-3022-4075-ab77-2212ff2e859d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "30ea5393da3343a0a6ea0b4cecd9cd8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3e0648c-cb", "ovs_interfaceid": "b3e0648c-cb25-4c7e-a25a-09a5dc4cee67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG os_vif [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3e0648c-cb, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:18:35 user nova-compute[73458]: INFO os_vif [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:8b:ec,bridge_name='br-int',has_traffic_filtering=True,id=b3e0648c-cb25-4c7e-a25a-09a5dc4cee67,network=Network(c9a6a52c-3022-4075-ab77-2212ff2e859d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3e0648c-cb')
Aug 27 01:18:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Deleting instance files /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4_del
Aug 27 01:18:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Deletion of /opt/stack/data/nova/instances/4b9c7070-5d15-4574-8cd4-a8c45a6053c4_del complete
Aug 27 01:18:35 user nova-compute[73458]: INFO nova.compute.manager [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 27 01:18:35 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:18:35 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Took 0.54 seconds to deallocate network for instance.
Aug 27 01:18:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG nova.compute.manager [req-d0e16ac5-36be-4ec5-a586-2d01edb83f90 req-05fb96ac-80c0-48c3-b058-01d10b6b80da service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-deleted-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:18:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:36 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Deleted allocations for instance 4b9c7070-5d15-4574-8cd4-a8c45a6053c4
Aug 27 01:18:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f95e7fc9-2ea7-4308-8528-4234bb326db4 tempest-VolumesNegativeTest-1771773228 tempest-VolumesNegativeTest-1771773228-project-member] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:18:37 user nova-compute[73458]: WARNING nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received unexpected event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with vm_state deleted and task_state None.
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:18:37 user nova-compute[73458]: WARNING nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received unexpected event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with vm_state deleted and task_state None.
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Acquiring lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] Lock "4b9c7070-5d15-4574-8cd4-a8c45a6053c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] No waiting events found dispatching network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:18:37 user nova-compute[73458]: WARNING nova.compute.manager [req-d9075210-e06d-4bac-9a97-a26e295382e2 req-f3273768-b70c-47f0-8c3d-7474be6bb1f4 service nova] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Received unexpected event network-vif-plugged-b3e0648c-cb25-4c7e-a25a-09a5dc4cee67 for instance with vm_state deleted and task_state None.
Aug 27 01:18:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:18:46 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:18:46 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:18:46 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8096MB free_disk=25.280162811279297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:18:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance ff905ded-7779-41e4-8d8c-c85944f554dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3059135e-0b8d-4450-ae5a-48bdd15128ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2db50725-3497-4a96-a23f-eee5ab7c46fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:18:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:18:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:50 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099115.7046187, 4b9c7070-5d15-4574-8cd4-a8c45a6053c4 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:18:50 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] VM Stopped (Lifecycle Event)
Aug 27 01:18:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0e4d5b4e-e968-4b35-a9dd-1282541123da None None] [instance: 4b9c7070-5d15-4574-8cd4-a8c45a6053c4] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:18:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updating instance_info_cache with network_info: [{"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-ff905ded-7779-41e4-8d8c-c85944f554dc" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:18:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:18:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:04 user nova-compute[73458]: INFO nova.compute.manager [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Terminating instance
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.compute.manager [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-unplugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] No waiting events found dispatching network-vif-unplugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.compute.manager [req-0caab5b3-e8f3-40a2-a852-3bd24ccb9aeb req-11fa8c8c-704c-4561-9fa2-a3fb778139e9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-unplugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:19:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Instance destroyed successfully.
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lazy-loading 'resources' on Instance uuid ff905ded-7779-41e4-8d8c-c85944f554dc {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1102225652',display_name='tempest-VolumesActionsTest-instance-1102225652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1102225652',id=43,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-lo3h0zfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:17:21Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=ff905ded-7779-41e4-8d8c-c85944f554dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "address": "fa:16:3e:fc:32:c8", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e2f437e-7d", "ovs_interfaceid": "7e2f437e-7d65-46dd-8ebf-bf058641ada4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG os_vif [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e2f437e-7d, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:19:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:04 user nova-compute[73458]: INFO os_vif [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:32:c8,bridge_name='br-int',has_traffic_filtering=True,id=7e2f437e-7d65-46dd-8ebf-bf058641ada4,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e2f437e-7d')
Aug 27 01:19:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Deleting instance files /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc_del
Aug 27 01:19:04 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Deletion of /opt/stack/data/nova/instances/ff905ded-7779-41e4-8d8c-c85944f554dc_del complete
Aug 27 01:19:05 user nova-compute[73458]: INFO nova.compute.manager [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 27 01:19:05 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:05 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Took 0.73 seconds to deallocate network for instance.
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-8ed14bd6-61fe-42cd-b8a1-dc93005f5949 req-176ba29d-2e54-4546-902b-648d22549dd9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-deleted-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:05 user nova-compute[73458]: INFO nova.compute.manager [req-8ed14bd6-61fe-42cd-b8a1-dc93005f5949 req-176ba29d-2e54-4546-902b-648d22549dd9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Neutron deleted interface 7e2f437e-7d65-46dd-8ebf-bf058641ada4; detaching it from the instance and deleting it from the info cache
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-8ed14bd6-61fe-42cd-b8a1-dc93005f5949 req-176ba29d-2e54-4546-902b-648d22549dd9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-8ed14bd6-61fe-42cd-b8a1-dc93005f5949 req-176ba29d-2e54-4546-902b-648d22549dd9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Detach interface failed, port_id=7e2f437e-7d65-46dd-8ebf-bf058641ada4, reason: Instance ff905ded-7779-41e4-8d8c-c85944f554dc could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:19:05 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:06 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Deleted allocations for instance ff905ded-7779-41e4-8d8c-c85944f554dc
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-04620c06-ce3e-49d6-aa07-6b8efedf3c0a tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.770s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] Acquiring lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] Lock "ff905ded-7779-41e4-8d8c-c85944f554dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:06 user nova-compute[73458]: DEBUG nova.compute.manager [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] No waiting events found dispatching network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:19:06 user nova-compute[73458]: WARNING nova.compute.manager [req-89b9a609-909b-480f-a195-d853ef4af858 req-3cec21f5-9506-45a5-92f9-518f67d884d9 service nova] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Received unexpected event network-vif-plugged-7e2f437e-7d65-46dd-8ebf-bf058641ada4 for instance with vm_state deleted and task_state None.
Aug 27 01:19:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:19 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099144.9178314, ff905ded-7779-41e4-8d8c-c85944f554dc => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:19:19 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] VM Stopped (Lifecycle Event)
Aug 27 01:19:19 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e9b65c44-e6ef-47de-a977-125dedf4f15c None None] [instance: ff905ded-7779-41e4-8d8c-c85944f554dc] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:19:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-changed-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:20 user nova-compute[73458]: DEBUG nova.compute.manager [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Refreshing instance network info cache due to event network-changed-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:19:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] Acquiring lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] Acquired lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:20 user nova-compute[73458]: DEBUG nova.network.neutron [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Refreshing network info cache for port ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG nova.network.neutron [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updated VIF entry in instance network info cache for port ab32b8a7-6c46-4b89-9137-cd7f5ca86d75. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG nova.network.neutron [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8f60f756-9a71-4ac2-8c5d-955f2c6a93bc req-abdca671-658d-4d5d-94a6-b97de7a5716b service nova] Releasing lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:21 user nova-compute[73458]: INFO nova.compute.manager [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attaching volume ebcbae7d-9428-4587-a27e-0e75196d7e3a to /dev/vdb
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.utils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2eb2a-6945-4e37-98b2-aebe33c9af4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86bce7a-4261-43e3-9223-f8d986c9149f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[76568a73-ffd5-4d67-98e2-e41c3ccb9740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b73d7e1-5bf1-4511-b442-5a17163f62ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:21 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:19:21 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a472d-89e3-46fd-815f-79670ec5add6]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG os_brick.utils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:21 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating existing volume attachment record: a67f4d81-a808-43e5-8e1f-4a95701c86d8 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:19:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-changed-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Refreshing instance network info cache due to event network-changed-a8813fcf-76eb-4bb1-aecd-a96b24363a03. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] Acquiring lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] Acquired lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Refreshing network info cache for port a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updated VIF entry in instance network info cache for port a8813fcf-76eb-4bb1-aecd-a96b24363a03. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updating instance_info_cache with network_info: [{"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9efe609d-9ef5-4aca-a5bc-2f54456a258e req-05b25f42-7c0f-409a-aaa7-70ec39ddc71a service nova] Releasing lock "refresh_cache-dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:30 user nova-compute[73458]: INFO nova.compute.manager [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Terminating instance
Aug 27 01:19:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Instance destroyed successfully.
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-145749021',display_name='tempest-TestVolumeBootPattern-server-145749021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-145749021',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-90iqplmm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:17:55Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "address": "fa:16:3e:f5:ba:e3", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8813fcf-76", "ovs_interfaceid": "a8813fcf-76eb-4bb1-aecd-a96b24363a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_vif [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8813fcf-76, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:31 user nova-compute[73458]: INFO os_vif [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:ba:e3,bridge_name='br-int',has_traffic_filtering=True,id=a8813fcf-76eb-4bb1-aecd-a96b24363a03,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8813fcf-76')
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:31 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90ff33-01a9-49a6-8fcb-c351bb46c938]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0b327-5f85-46e2-bb51-268aa099418a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:19:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:19:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9eae1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d24d32-f0d7-48bd-a941-9f2453b155c8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bafd3b-011b-41b5-96d9-ee98e834d769]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5bbc94-b054-49f9-9450-161306e86714]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[411deac5-51eb-4212-9565-d6b7a4495083]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe66df42-94249ea8a11cbfa6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e66df42', '/dev/disk/by-id/scsi-23934323439656138') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59064d1-50b8-4921-9fba-8c49b836f030]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[16011a5b-36b9-4eb0-8483-cde515c6c00a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca760e-3902-4391-924d-4d361f644048]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]
Aug 27 01:19:31 user nova-compute[73458]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.
Aug 27 01:19:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[130dead4-b05f-4d89-8261-117a89bee269]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (281ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:19:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Deleting instance files /opt/stack/data/nova/instances/dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad_del
Aug 27 01:19:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Deletion of /opt/stack/data/nova/instances/dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad_del complete
Aug 27 01:19:31 user nova-compute[73458]: INFO nova.compute.manager [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 27 01:19:31 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:19:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-unplugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] No waiting events found dispatching network-vif-unplugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-unplugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Acquiring lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] No waiting events found dispatching network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:19:32 user nova-compute[73458]: WARNING nova.compute.manager [req-e6095b94-37d7-47da-ab89-be81e90ea1d2 req-b949a4bc-e184-4c2e-90cd-2446b2cef11c service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received unexpected event network-vif-plugged-a8813fcf-76eb-4bb1-aecd-a96b24363a03 for instance with vm_state active and task_state deleting.
Aug 27 01:19:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:32 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Took 0.97 seconds to deallocate network for instance.
Aug 27 01:19:33 user nova-compute[73458]: INFO nova.compute.manager [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Took 0.81 seconds to detach 1 volumes for instance.
Aug 27 01:19:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:19:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:19:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:34 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad
Aug 27 01:19:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-2f73f373-d104-4ad8-9808-8a4ff6e11087 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.423s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:34 user nova-compute[73458]: DEBUG nova.compute.manager [req-5cd4b8cf-1357-40bf-a5a4-2bbf36e6192b req-3f1506e1-0bf4-4fe3-acfe-ae2be36261df service nova] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Received event network-vif-deleted-a8813fcf-76eb-4bb1-aecd-a96b24363a03 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBSXVmqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:39 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eff669-eb3a-4ada-b29e-d19790f4cfa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:19:39 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb76ea2-5946-4b5d-b084-aac4b88bbbc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a] added
Aug 27 01:19:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf21a7-48ab-4516-a938-9f76025a33ae]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24bdd7-1984-4f6c-9d9b-98ff8168b0fa]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBSXVmqe {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NBSXVmqe" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c5a87-9711-4d68-a77d-36e479d9e5fd]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NBSXVmqe'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a4ac8-b80e-4763-a3e6-01fc532fca5c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[70181a68-1d49-4f79-a126-ab004366171a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:19:39 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:19:39 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:39 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:19:39 user nova-compute[73458]: 
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[68507734-b646-4bcb-bf3b-1a99259a8b61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260]
Aug 27 01:19:39 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260] successful.
Aug 27 01:19:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95569e72-e608-4b0c-8d92-64de59672f77]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f160b1-5d81-4cbd-bafc-81c6b8990aae]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:39 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.049s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8062246-489c-424b-a04c-e6aa1deba951]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:19:39 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBSXVmqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:19:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23034663963313564', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663963313564', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:19:40 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:19:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:19:40 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:19:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:19:40 user nova-compute[73458]:   <serial>ebcbae7d-9428-4587-a27e-0e75196d7e3a</serial>
Aug 27 01:19:40 user nova-compute[73458]: </disk>
Aug 27 01:19:40 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:19:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:19:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:19:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No VIF found with MAC fa:16:3e:18:7e:0e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:19:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f8ad5ed7-a562-4ed5-8fa4-a4137422aae4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.818s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-changed-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Refreshing instance network info cache due to event network-changed-6e804a70-676c-4404-ba0b-8129a350d3d4. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] Acquiring lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] Acquired lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:44 user nova-compute[73458]: DEBUG nova.network.neutron [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Refreshing network info cache for port 6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Ignoring supplied device name: /dev/vdb
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:45 user nova-compute[73458]: INFO nova.compute.manager [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Attaching volume f83a6a7f-27a4-4d2b-8903-6f7d722ea177 to /dev/vdb
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:45 user nova-compute[73458]: INFO nova.compute.manager [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attaching volume bb0f1c2f-508a-4874-84fa-e1205e4a81cf to /dev/vdc
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updated VIF entry in instance network info cache for port 6e804a70-676c-4404-ba0b-8129a350d3d4. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.network.neutron [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updating instance_info_cache with network_info: [{"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-dc6886ea-f921-44c3-aa16-122c7006f8db req-0199b432-dc62-4090-acb7-4d2563f0a769 service nova] Releasing lock "refresh_cache-2db50725-3497-4a96-a23f-eee5ab7c46fe" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.utils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.utils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2ac10-4d3d-44c8-9f7e-19e2b3811101]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaee9b08-f9b1-4681-870b-101e7c65903f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0ff7ec-2a50-4ef8-87c8-060fa3942ba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc6bbdb-07fb-42b6-92e9-4a15fd034cd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d9fd6a-7a60-4ea0-a412-b1d9893a9215]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0a40f-f978-4ae2-90eb-0142c7c5c524]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d1c488-4f5f-4df1-b794-c8a61564bdf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96131661-4cfc-4f91-90ab-7c8091313afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:45 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d13c7-2642-4559-a2f6-b287adafb96b]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.utils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updating existing volume attachment record: 0173a21d-2f63-43da-88cb-b7a8c03a00e9 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:19:45 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:19:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308af4a-9234-49c0-a097-7316dba96ee0]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG os_brick.utils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:45 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating existing volume attachment record: c792370d-e36b-4e47-8c89-6a207f5c450a {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:19:46 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099171.5241852, dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:19:46 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] VM Stopped (Lifecycle Event)
Aug 27 01:19:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b5768baa-6a46-4e3b-9d75-290e039fdec3 None None] [instance: dc5bdd28-2d3c-4da7-813f-71b5b58bf5ad] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:19:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:19:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:19:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=25.30516815185547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3059135e-0b8d-4450-ae5a-48bdd15128ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 2db50725-3497-4a96-a23f-eee5ab7c46fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:19:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:19:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:19:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:19:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:19:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:19:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:19:56 user nova-compute[73458]: INFO nova.compute.claims [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Claim successful on node user
Aug 27 01:19:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:19:56 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.policy [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b6c0a31ff2f452dbd1d22ef6f3e8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a2616fd21b4ca583aaf00b569d1242', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:19:56 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Creating image(s)
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "/opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "/opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "/opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.204s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk 1073741824" returned: 0 in 0.060s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKwQzAsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:57 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ded85d-7e4d-4b2b-8097-03e19a1d8b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:19:57 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a0100-e5f9-4e3a-a581-de7425633b4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177] added
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23243d-c5c3-4e6d-9c31-7ed530c3845d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286f41f-6e77-4973-91ae-dce64785a9bc]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKwQzAsb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MKwQzAsb" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c9a65-fcaa-40d3-ad43-b1441006af07]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MKwQzAsb'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnfewvDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:19:57 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Successfully created port: 711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87dda99-f85c-480d-b8b6-bea55f87ff5d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef4aab9-f79a-437d-9fab-cbbee740dc5b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed9bf5-45d7-4e3d-9209-d913436cea8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260]
Aug 27 01:19:57 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260] successful.
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3429a7e9-0ff2-4e1e-9e93-81d11a6f6025]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Cannot resize image /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Ensure instance console log exists: /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6b54d-cf11-4d83-b0dd-69184b217c86]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:57 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:57 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:57 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed1811-64cf-4700-84d4-c6e11cc2c83c]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:57 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Successfully updated port: 711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquired lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-changed-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Refreshing instance network info cache due to event network-changed-711df4d6-febb-4727-9257-8ef14b96f560. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] Acquiring lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKwQzAsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26138356362643865', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138356362643865', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.196s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:58 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:19:58 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec224f-2080-4b13-bc8a-c2aa76cbc964]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:19:58 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:19:58 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:19:58 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:19:58 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:19:58 user nova-compute[73458]:   <serial>f83a6a7f-27a4-4d2b-8903-6f7d722ea177</serial>
Aug 27 01:19:58 user nova-compute[73458]: </disk>
Aug 27 01:19:58 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d7398e-d077-4b03-998e-bfddee5ad0a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf] added
Aug 27 01:19:58 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4064bc5f-e336-4fff-9b92-03dd8868a272]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[355f6dd5-4dff-4199-837c-acf02cd28ba0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:58 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnfewvDJ {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnfewvDJ" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[99520409-e0bc-497a-81f1-e1bd62613116]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnfewvDJ'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43117e8d-3174-429a-925c-6e0285598e15]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a63e9-c8b6-48db-a1ba-39848f842a1d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.neutron [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Updating instance_info_cache with network_info: [{"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Releasing lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Instance network_info: |[{"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] Acquired lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.neutron [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Refreshing network info cache for port 711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Start _get_guest_xml network_info=[{"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9971f85d-e8d0-4989-9440-8b73b05eabb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260]
Aug 27 01:19:59 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260] successful.
Aug 27 01:19:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:19:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547665160',display_name='tempest-VolumesActionsTest-instance-547665160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-547665160',id=47,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-mpyy1p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:19:57Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=b35272e7-9ef1-4d23-b823-62783489efca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lazy-loading 'pci_devices' on Instance uuid b35272e7-9ef1-4d23-b823-62783489efca {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb393ff1-b941-4a27-b96b-329a9a247bd6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:19:59 user nova-compute[73458]:   <uuid>b35272e7-9ef1-4d23-b823-62783489efca</uuid>
Aug 27 01:19:59 user nova-compute[73458]:   <name>instance-0000002f</name>
Aug 27 01:19:59 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:19:59 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:19:59 user nova-compute[73458]:   <metadata>
Aug 27 01:19:59 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:19:59 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:name>tempest-VolumesActionsTest-instance-547665160</nova:name>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:19:59</nova:creationTime>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:19:59 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:19:59 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:owner>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:user uuid="4b6c0a31ff2f452dbd1d22ef6f3e8a82">tempest-VolumesActionsTest-1585999825-project-member</nova:user>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:project uuid="d6a2616fd21b4ca583aaf00b569d1242">tempest-VolumesActionsTest-1585999825</nova:project>
Aug 27 01:19:59 user nova-compute[73458]:       </nova:owner>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:19:59 user nova-compute[73458]:       <nova:ports>
Aug 27 01:19:59 user nova-compute[73458]:         <nova:port uuid="711df4d6-febb-4727-9257-8ef14b96f560">
Aug 27 01:19:59 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 01:19:59 user nova-compute[73458]:         </nova:port>
Aug 27 01:19:59 user nova-compute[73458]:       </nova:ports>
Aug 27 01:19:59 user nova-compute[73458]:     </nova:instance>
Aug 27 01:19:59 user nova-compute[73458]:   </metadata>
Aug 27 01:19:59 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:19:59 user nova-compute[73458]:     <system>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="serial">b35272e7-9ef1-4d23-b823-62783489efca</entry>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="uuid">b35272e7-9ef1-4d23-b823-62783489efca</entry>
Aug 27 01:19:59 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:19:59 user nova-compute[73458]:     </system>
Aug 27 01:19:59 user nova-compute[73458]:   </sysinfo>
Aug 27 01:19:59 user nova-compute[73458]:   <os>
Aug 27 01:19:59 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:19:59 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:19:59 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:19:59 user nova-compute[73458]:   </os>
Aug 27 01:19:59 user nova-compute[73458]:   <features>
Aug 27 01:19:59 user nova-compute[73458]:     <acpi/>
Aug 27 01:19:59 user nova-compute[73458]:     <apic/>
Aug 27 01:19:59 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:19:59 user nova-compute[73458]:   </features>
Aug 27 01:19:59 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:19:59 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:19:59 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:19:59 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:19:59 user nova-compute[73458]:   </clock>
Aug 27 01:19:59 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:19:59 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:19:59 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:19:59 user nova-compute[73458]:   </cpu>
Aug 27 01:19:59 user nova-compute[73458]:   <devices>
Aug 27 01:19:59 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:19:59 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:19:59 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk"/>
Aug 27 01:19:59 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:19:59 user nova-compute[73458]:     </disk>
Aug 27 01:19:59 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:19:59 user nova-compute[73458]:       <mac address="fa:16:3e:04:5c:08"/>
Aug 27 01:19:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:19:59 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:19:59 user nova-compute[73458]:       <target dev="tap711df4d6-fe"/>
Aug 27 01:19:59 user nova-compute[73458]:     </interface>
Aug 27 01:19:59 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:19:59 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/console.log" append="off"/>
Aug 27 01:19:59 user nova-compute[73458]:     </serial>
Aug 27 01:19:59 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:19:59 user nova-compute[73458]:     <video>
Aug 27 01:19:59 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:19:59 user nova-compute[73458]:     </video>
Aug 27 01:19:59 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:19:59 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:19:59 user nova-compute[73458]:     </rng>
Aug 27 01:19:59 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:19:59 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:19:59 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:19:59 user nova-compute[73458]:     </memballoon>
Aug 27 01:19:59 user nova-compute[73458]:   </devices>
Aug 27 01:19:59 user nova-compute[73458]: </domain>
Aug 27 01:19:59 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547665160',display_name='tempest-VolumesActionsTest-instance-547665160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-547665160',id=47,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-mpyy1p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:19:57Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=b35272e7-9ef1-4d23-b823-62783489efca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_vif [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[455a8b92-9eb3-463e-b38f-efbd2bbce13f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)
Aug 27 01:19:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:19:59 user nova-compute[73458]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)
Aug 27 01:19:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap711df4d6-fe, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap711df4d6-fe, col_values=(('external_ids', {'iface-id': '711df4d6-febb-4727-9257-8ef14b96f560', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:5c:08', 'vm-uuid': 'b35272e7-9ef1-4d23-b823-62783489efca'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:59 user nova-compute[73458]: INFO os_vif [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe')
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e446da-74bc-4a84-afb9-09de746fede7]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnfewvDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] No VIF found with MAC fa:16:3e:04:5c:08, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] No VIF found with MAC fa:16:3e:bc:d4:58, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cf2b5568-35c7-488f-b88f-7455e8df18b1 tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.967s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.neutron [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Updated VIF entry in instance network info cache for port 711df4d6-febb-4727-9257-8ef14b96f560. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG nova.network.neutron [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Updating instance_info_cache with network_info: [{"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:19:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-12cf5669-d0d2-4dea-b2f2-87c9489302e9 req-c16565be-a99f-4804-a37b-18d3ba6be9c1 service nova] Releasing lock "refresh_cache-b35272e7-9ef1-4d23-b823-62783489efca" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== connect_volume: return (2597ms) {'type': 'block', 'scsi_wwn': '23238666364386130', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238666364386130', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:20:00 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:00 user nova-compute[73458]:   <source dev="/dev/sdd"/>
Aug 27 01:20:00 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:20:00 user nova-compute[73458]:   <serial>bb0f1c2f-508a-4874-84fa-e1205e4a81cf</serial>
Aug 27 01:20:00 user nova-compute[73458]: </disk>
Aug 27 01:20:00 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] No waiting events found dispatching network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:00 user nova-compute[73458]: WARNING nova.compute.manager [req-4f2506fb-659b-49bd-9ecd-d5a1e0037233 req-05a1a5c2-fee2-4801-8fce-915640131017 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received unexpected event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 for instance with vm_state building and task_state spawning.
Aug 27 01:20:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] No VIF found with MAC fa:16:3e:18:7e:0e, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ca92f1c0-2c36-476d-bf8f-1abec034f31d tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.778s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:02 user nova-compute[73458]: INFO nova.compute.manager [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Detaching volume bb0f1c2f-508a-4874-84fa-e1205e4a81cf
Aug 27 01:20:02 user nova-compute[73458]: INFO nova.virt.block_device [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attempting to driver detach volume bb0f1c2f-508a-4874-84fa-e1205e4a81cf from mountpoint /dev/vdc
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Attempting to detach device vdc from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:02 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:02 user nova-compute[73458]:   <source dev="/dev/sdd"/>
Aug 27 01:20:02 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:20:02 user nova-compute[73458]:   <serial>bb0f1c2f-508a-4874-84fa-e1205e4a81cf</serial>
Aug 27 01:20:02 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 01:20:02 user nova-compute[73458]: </disk>
Aug 27 01:20:02 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully detached device vdc from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the persistent domain config.
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:02 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:02 user nova-compute[73458]:   <source dev="/dev/sdd"/>
Aug 27 01:20:02 user nova-compute[73458]:   <target dev="vdc" bus="virtio"/>
Aug 27 01:20:02 user nova-compute[73458]:   <serial>bb0f1c2f-508a-4874-84fa-e1205e4a81cf</serial>
Aug 27 01:20:02 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 01:20:02 user nova-compute[73458]: </disk>
Aug 27 01:20:02 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] No waiting events found dispatching network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:02 user nova-compute[73458]: WARNING nova.compute.manager [req-ff63270f-f5e2-4ac2-a02a-63f39df82dbf req-72ad76e0-fb6f-4e0c-ad08-ab79d0679216 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received unexpected event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 for instance with vm_state building and task_state spawning.
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099202.9827065, 3059135e-0b8d-4450-ae5a-48bdd15128ba => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:20:02 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully detached device vdc from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the live domain config.
Aug 27 01:20:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:20:02 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnfewvDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:03 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[589545fc-5855-4d89-a3b0-834c7de03167]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe6d5f-3f12-4f1a-ad86-7197a7cb3d6b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:03 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:03 user nova-compute[73458]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)
Aug 27 01:20:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:03 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:03 user nova-compute[73458]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf (non-flash)
Aug 27 01:20:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786e45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c3bf8c-766f-4243-9fbf-8beec410fcfe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7843c3e-9eab-4a34-a679-50a613b7d8b5]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8b9e05-fd10-4560-80c0-89ddcb198423]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d4d41-a765-4905-8c38-7853fa86b260]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163f5d6-f622-4431-889b-7b1e6555b7a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b8953e-d30c-48f2-9167-b7f6a15b1993]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260]
Aug 27 01:20:03 user nova-compute[73458]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf, portal: 172.16.0.220,3260] successful.
Aug 27 01:20:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0f1c2f-508a-4874-84fa-e1205e4a81cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f324a4a2-d033-44c5-b72a-88452465b63c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== disconnect_volume: return (327ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099203.3915617, b35272e7-9ef1-4d23-b823-62783489efca => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] VM Resumed (Lifecycle Event)
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Instance spawned successfully.
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099203.3926706, b35272e7-9ef1-4d23-b823-62783489efca => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] VM Started (Lifecycle Event)
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 27 01:20:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:03 user nova-compute[73458]: INFO nova.compute.manager [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Took 7.37 seconds to build instance.
Aug 27 01:20:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8ad353e3-5659-4a3e-88bb-d43865a58327 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ffcdf6d2-47e7-4f29-978d-19d885321150 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.922s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:20:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:20:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:20:22 user nova-compute[73458]: INFO nova.compute.claims [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Claim successful on node user
Aug 27 01:20:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:20:22 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:20:23 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.policy [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:20:23 user nova-compute[73458]: INFO nova.virt.block_device [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Booting with volume 1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 at /dev/vda
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.utils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cc99cc-b44f-4cb2-a217-a1545f6bf611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f731f2-7781-4f6b-9909-8cf879f6ac1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210f882-f251-4aba-a350-750ed1c30d3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d14a81-3f3f-4843-be5c-93b28c4ce303]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:20:23 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:20:23 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc53d1f-d377-48ee-b3b4-ee92f3b2468d]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG os_brick.utils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:23 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating existing volume attachment record: 30c72cb2-02db-4a33-ad49-79ec0ca32caf {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:20:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Successfully created port: 86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:20:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Successfully updated port: 86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-changed-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing instance network info cache due to event network-changed-86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.network.neutron [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Instance network_info: |[{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:20:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:20:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updated VIF entry in instance network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:20:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ad2e9309-ee4b-48c1-b79a-aff2c1b9f217 req-ff062c75-bc9c-43ce-80f1-4fb99e0bc4bc service nova] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:20:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Creating image(s)
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Ensure instance console log exists: /opt/stack/data/nova/instances/75772d06-1345-4897-834b-b5cf5b54b19a/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Start _get_guest_xml network_info=[{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '75772d06-1345-4897-834b-b5cf5b54b19a', 'attached_at': '', 'detached_at': '', 'volume_id': '1df90b5a-c563-44a4-bcb5-c5a2eb63ace7', 'serial': '1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '30c72cb2-02db-4a33-ad49-79ec0ca32caf', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:20:35 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:35 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:35 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:35 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:35 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59aa94a-700d-46a0-9046-7619071470c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:20:35 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ed191c-6fdc-48c9-838b-b8642abeb70b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7] added
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.141s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a9e2f-3829-4aa4-a8a9-c3703d201e29]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c99b6b-857e-48dd-a7d5-f91cd37632d9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVqGxUim {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVqGxUim" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93654c2e-eec7-4649-853a-f6c9d6ff6664]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVqGxUim'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a7e77-b99a-40d7-bf43-00e3a02f889e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e70785-d555-4c19-b7b4-6d33354addf6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3167e33c-112e-4c69-8498-065a3602454e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]
Aug 27 01:20:35 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63763400-76d2-43f4-ab2b-2d4acdf61aa3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410511e-517a-4335-83c2-e28ed4a935ee]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe96923-b9c8-4682-876e-f26f4fb1b211]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:20:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23934323439656138', 'path': '/dev/sdd'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934323439656138', 'path': '/dev/sdd'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1068345530',display_name='tempest-TestVolumeBootPattern-server-1068345530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1068345530',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-9t20upqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:20:23Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=75772d06-1345-4897-834b-b5cf5b54b19a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid 75772d06-1345-4897-834b-b5cf5b54b19a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:20:36 user nova-compute[73458]:   <uuid>75772d06-1345-4897-834b-b5cf5b54b19a</uuid>
Aug 27 01:20:36 user nova-compute[73458]:   <name>instance-00000030</name>
Aug 27 01:20:36 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:20:36 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:20:36 user nova-compute[73458]:   <metadata>
Aug 27 01:20:36 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:20:36 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:20:36 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-server-1068345530</nova:name>
Aug 27 01:20:36 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:20:35</nova:creationTime>
Aug 27 01:20:36 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:20:36 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:20:36 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:20:36 user nova-compute[73458]:       <nova:owner>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:20:36 user nova-compute[73458]:       </nova:owner>
Aug 27 01:20:36 user nova-compute[73458]:       <nova:ports>
Aug 27 01:20:36 user nova-compute[73458]:         <nova:port uuid="86eb481a-763d-470b-bf61-9b600084ac99">
Aug 27 01:20:36 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:20:36 user nova-compute[73458]:         </nova:port>
Aug 27 01:20:36 user nova-compute[73458]:       </nova:ports>
Aug 27 01:20:36 user nova-compute[73458]:     </nova:instance>
Aug 27 01:20:36 user nova-compute[73458]:   </metadata>
Aug 27 01:20:36 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:20:36 user nova-compute[73458]:     <system>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="serial">75772d06-1345-4897-834b-b5cf5b54b19a</entry>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="uuid">75772d06-1345-4897-834b-b5cf5b54b19a</entry>
Aug 27 01:20:36 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:20:36 user nova-compute[73458]:     </system>
Aug 27 01:20:36 user nova-compute[73458]:   </sysinfo>
Aug 27 01:20:36 user nova-compute[73458]:   <os>
Aug 27 01:20:36 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:20:36 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:20:36 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:20:36 user nova-compute[73458]:   </os>
Aug 27 01:20:36 user nova-compute[73458]:   <features>
Aug 27 01:20:36 user nova-compute[73458]:     <acpi/>
Aug 27 01:20:36 user nova-compute[73458]:     <apic/>
Aug 27 01:20:36 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:20:36 user nova-compute[73458]:   </features>
Aug 27 01:20:36 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:20:36 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:20:36 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:20:36 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:20:36 user nova-compute[73458]:   </clock>
Aug 27 01:20:36 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:20:36 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:20:36 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:20:36 user nova-compute[73458]:   </cpu>
Aug 27 01:20:36 user nova-compute[73458]:   <devices>
Aug 27 01:20:36 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:20:36 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:36 user nova-compute[73458]:       <source dev="/dev/sdd"/>
Aug 27 01:20:36 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:20:36 user nova-compute[73458]:       <serial>1df90b5a-c563-44a4-bcb5-c5a2eb63ace7</serial>
Aug 27 01:20:36 user nova-compute[73458]:     </disk>
Aug 27 01:20:36 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:20:36 user nova-compute[73458]:       <mac address="fa:16:3e:c4:50:1d"/>
Aug 27 01:20:36 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:20:36 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:20:36 user nova-compute[73458]:       <target dev="tap86eb481a-76"/>
Aug 27 01:20:36 user nova-compute[73458]:     </interface>
Aug 27 01:20:36 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:20:36 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/75772d06-1345-4897-834b-b5cf5b54b19a/console.log" append="off"/>
Aug 27 01:20:36 user nova-compute[73458]:     </serial>
Aug 27 01:20:36 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:20:36 user nova-compute[73458]:     <video>
Aug 27 01:20:36 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:20:36 user nova-compute[73458]:     </video>
Aug 27 01:20:36 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:20:36 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:20:36 user nova-compute[73458]:     </rng>
Aug 27 01:20:36 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:20:36 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:20:36 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:20:36 user nova-compute[73458]:     </memballoon>
Aug 27 01:20:36 user nova-compute[73458]:   </devices>
Aug 27 01:20:36 user nova-compute[73458]: </domain>
Aug 27 01:20:36 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1068345530',display_name='tempest-TestVolumeBootPattern-server-1068345530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1068345530',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-9t20upqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:20:23Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=75772d06-1345-4897-834b-b5cf5b54b19a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG os_vif [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86eb481a-76, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86eb481a-76, col_values=(('external_ids', {'iface-id': '86eb481a-763d-470b-bf61-9b600084ac99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:50:1d', 'vm-uuid': '75772d06-1345-4897-834b-b5cf5b54b19a'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:20:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:36 user nova-compute[73458]: INFO os_vif [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76')
Aug 27 01:20:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:20:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:c4:50:1d, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:20:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:38 user nova-compute[73458]: DEBUG nova.compute.manager [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] No waiting events found dispatching network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:38 user nova-compute[73458]: WARNING nova.compute.manager [req-51fd9b79-8eae-4efe-b982-8e29bd84b2aa req-b1ad791e-7f97-4b55-a937-ccdfcca9aab9 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received unexpected event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 for instance with vm_state building and task_state spawning.
Aug 27 01:20:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] No waiting events found dispatching network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:40 user nova-compute[73458]: WARNING nova.compute.manager [req-e46f8b97-4089-48c5-bd98-bc6bd181ac4d req-62ccc076-836d-462a-bbb4-b7f729437a86 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received unexpected event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 for instance with vm_state building and task_state spawning.
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099240.9135904, 75772d06-1345-4897-834b-b5cf5b54b19a => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:40 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] VM Resumed (Lifecycle Event)
Aug 27 01:20:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Instance spawned successfully.
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:40 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:40 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099240.9156244, 75772d06-1345-4897-834b-b5cf5b54b19a => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:40 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] VM Started (Lifecycle Event)
Aug 27 01:20:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:41 user nova-compute[73458]: INFO nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Took 5.65 seconds to spawn the instance on the hypervisor.
Aug 27 01:20:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:41 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:41 user nova-compute[73458]: INFO nova.compute.manager [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Took 18.29 seconds to build instance.
Aug 27 01:20:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f0476380-bd87-4a86-872c-d5219ef0f7d0 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.400s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:42 user nova-compute[73458]: INFO nova.compute.manager [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Detaching volume f83a6a7f-27a4-4d2b-8903-6f7d722ea177
Aug 27 01:20:43 user nova-compute[73458]: INFO nova.virt.block_device [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Attempting to driver detach volume f83a6a7f-27a4-4d2b-8903-6f7d722ea177 from mountpoint /dev/vdb
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Attempting to detach device vdb from instance 2db50725-3497-4a96-a23f-eee5ab7c46fe from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:43 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:43 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:20:43 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:20:43 user nova-compute[73458]:   <serial>f83a6a7f-27a4-4d2b-8903-6f7d722ea177</serial>
Aug 27 01:20:43 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:20:43 user nova-compute[73458]: </disk>
Aug 27 01:20:43 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully detached device vdb from instance 2db50725-3497-4a96-a23f-eee5ab7c46fe from the persistent domain config.
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2db50725-3497-4a96-a23f-eee5ab7c46fe from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:43 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:43 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:20:43 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:20:43 user nova-compute[73458]:   <serial>f83a6a7f-27a4-4d2b-8903-6f7d722ea177</serial>
Aug 27 01:20:43 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:20:43 user nova-compute[73458]: </disk>
Aug 27 01:20:43 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099243.6604168, 2db50725-3497-4a96-a23f-eee5ab7c46fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:20:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully detached device vdb from instance 2db50725-3497-4a96-a23f-eee5ab7c46fe from the live domain config.
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKwQzAsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:43 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff609f-cbf0-48f1-8ec1-b0b02602115f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3d7b2-dc9d-41b9-9abf-1ad114db8923]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:43 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:43 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:43 user nova-compute[73458]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 (non-flash)
Aug 27 01:20:43 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7859b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[657383d2-8bea-4da6-af14-5c0c266bdfa4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4277b-dbbb-4aea-8bd7-90b4a31cb085]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[905698f0-779a-4e6b-8397-858388def019]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4905ba0-e936-41c4-bfc8-20b1529951d5]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8ee6c0-1052-43ea-9554-01992de8cb7f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f992d660-0d06-40bb-ad1f-aaf167d40b9e]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260]
Aug 27 01:20:43 user nova-compute[73458]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177, portal: 172.16.0.220,3260] successful.
Aug 27 01:20:43 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c124c3-12b8-4d94-8a06-14ebd8b6e4d3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== disconnect_volume: return (309ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:20:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:44 user nova-compute[73458]: DEBUG nova.objects.instance [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'flavor' on Instance uuid 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-8f656936-6ab0-4138-8f36-705ee7a56abd tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.097s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.842s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:45 user nova-compute[73458]: INFO nova.compute.manager [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Terminating instance
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-unplugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-unplugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-4e9ec1b8-0d82-4cfd-ba9d-f1db8d06b28e req-df137982-e49f-4343-83da-9abee62e4593 service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-unplugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Instance destroyed successfully.
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lazy-loading 'resources' on Instance uuid 2db50725-3497-4a96-a23f-eee5ab7c46fe {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1659119290',display_name='tempest-VolumesSnapshotTestJSON-instance-1659119290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1659119290',id=46,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKl6N05OnOACUw6FD5EEVQ4ccfVLaJ13NthpuplsOYDcstpvlaaUhOtgXFMwz3TbFer4/HWYaERxa+IVjpDg/yQTwLflVu+5HFr1+LQ43CAX1q/O9lCl/nryKCvVrdgTg==',key_name='tempest-keypair-887399242',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdaf1e6e531a4d53a6f275560bbb93a0',ramdisk_id='',reservation_id='r-i0zj6sw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-677137363',owner_user_name='tempest-VolumesSnapshotTestJSON-677137363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:18:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e8655de65e14eedb2eb239b20fe697f',uuid=2db50725-3497-4a96-a23f-eee5ab7c46fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converting VIF {"id": "6e804a70-676c-4404-ba0b-8129a350d3d4", "address": "fa:16:3e:bc:d4:58", "network": {"id": "92ac19a4-2933-4554-995d-cc73a9d886c3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-96867407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdaf1e6e531a4d53a6f275560bbb93a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e804a70-67", "ovs_interfaceid": "6e804a70-676c-4404-ba0b-8129a350d3d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_vif [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e804a70-67, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:45 user nova-compute[73458]: INFO os_vif [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d4:58,bridge_name='br-int',has_traffic_filtering=True,id=6e804a70-676c-4404-ba0b-8129a350d3d4,network=Network(92ac19a4-2933-4554-995d-cc73a9d886c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e804a70-67')
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MKwQzAsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f83a6a7f-27a4-4d2b-8903-6f7d722ea177', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9214119-0c7a-41f8-a666-cc736f2a585d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f0c606-ce3d-4b79-8416-869427828241]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:45 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:45 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786e4940>, {}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Disconnecting from: [] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] <== disconnect_volume: return (66ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:20:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Deleting instance files /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe_del
Aug 27 01:20:45 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Deletion of /opt/stack/data/nova/instances/2db50725-3497-4a96-a23f-eee5ab7c46fe_del complete
Aug 27 01:20:46 user nova-compute[73458]: INFO nova.compute.manager [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 27 01:20:46 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:47 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Took 1.01 seconds to deallocate network for instance.
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb79c423-22a2-4ba6-8caf-7440b9c57295 req-0c48150c-2269-40bb-9aaa-e8ec87e46b7f service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-deleted-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:47 user nova-compute[73458]: WARNING nova.volume.cinder [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Attachment 0173a21d-2f63-43da-88cb-b7a8c03a00e9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0173a21d-2f63-43da-88cb-b7a8c03a00e9. (HTTP 404) (Request-ID: req-429b6409-db8b-4332-b693-5c9094960740)
Aug 27 01:20:47 user nova-compute[73458]: INFO nova.compute.manager [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Took 0.02 seconds to detach 1 volumes for instance.
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.054s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:20:47 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Deleted allocations for instance 2db50725-3497-4a96-a23f-eee5ab7c46fe
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:47 user nova-compute[73458]: WARNING nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received unexpected event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with vm_state deleted and task_state None.
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:47 user nova-compute[73458]: WARNING nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received unexpected event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with vm_state deleted and task_state None.
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Acquiring lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] No waiting events found dispatching network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:47 user nova-compute[73458]: WARNING nova.compute.manager [req-419e8ad5-19cb-4fe7-b3d2-2d44b06e0d74 req-f571c82c-7918-4736-99d5-9b928ec4f1ff service nova] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Received unexpected event network-vif-plugged-6e804a70-676c-4404-ba0b-8129a350d3d4 for instance with vm_state deleted and task_state None.
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-c62c638c-0a8a-49ad-9c78-e540fee8d7af tempest-VolumesSnapshotTestJSON-677137363 tempest-VolumesSnapshotTestJSON-677137363-project-member] Lock "2db50725-3497-4a96-a23f-eee5ab7c46fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:20:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:20:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:48 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8241MB free_disk=25.292095184326172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 3059135e-0b8d-4450-ae5a-48bdd15128ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance b35272e7-9ef1-4d23-b823-62783489efca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 75772d06-1345-4897-834b-b5cf5b54b19a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.136s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:20:49 user nova-compute[73458]: INFO nova.compute.claims [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Claim successful on node user
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:20:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.policy [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '579b8975446647ad8d4d9bae2aaf819a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '087c2bacaf3c434580685e208b7f8529', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:20:49 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Creating image(s)
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "/opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "/opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "/opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk 1073741824" returned: 0 in 0.062s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Successfully created port: a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Cannot resize image /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Ensure instance console log exists: /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Successfully updated port: a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-changed-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Refreshing instance network info cache due to event network-changed-a62c6714-91cd-442b-a127-4529b553db2a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:20:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Instance network_info: |[{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Refreshing network info cache for port a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Start _get_guest_xml network_info=[{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:20:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:51 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152561704',display_name='tempest-SnapshotDataIntegrityTests-server-152561704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152561704',id=49,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJllXs3Tazy8UlVF3Q1v+vqV6OUQ1sW7dkNrLbGGBOj1d//car8+U7SDoli9aKzYF+5Au4PiWxAbEFZR+RN8vqgb+uOwD0l0as3M+rUoza2TuHJO6qydPuhVQc5WTieMA==',key_name='tempest-keypair-914303875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='087c2bacaf3c434580685e208b7f8529',ramdisk_id='',reservation_id='r-js07o95e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1339359446',owner_user_name='tempest-SnapshotDataIntegrityTests-1339359446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579b8975446647ad8d4d9bae2aaf819a',uuid=8289084b-7977-4511-a59e-2d9a2b46fd9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converting VIF {"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'pci_devices' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:20:51 user nova-compute[73458]:   <uuid>8289084b-7977-4511-a59e-2d9a2b46fd9d</uuid>
Aug 27 01:20:51 user nova-compute[73458]:   <name>instance-00000031</name>
Aug 27 01:20:51 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:20:51 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:20:51 user nova-compute[73458]:   <metadata>
Aug 27 01:20:51 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:20:51 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-152561704</nova:name>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:20:51</nova:creationTime>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:20:51 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:20:51 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:owner>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:user uuid="579b8975446647ad8d4d9bae2aaf819a">tempest-SnapshotDataIntegrityTests-1339359446-project-member</nova:user>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:project uuid="087c2bacaf3c434580685e208b7f8529">tempest-SnapshotDataIntegrityTests-1339359446</nova:project>
Aug 27 01:20:51 user nova-compute[73458]:       </nova:owner>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:20:51 user nova-compute[73458]:       <nova:ports>
Aug 27 01:20:51 user nova-compute[73458]:         <nova:port uuid="a62c6714-91cd-442b-a127-4529b553db2a">
Aug 27 01:20:51 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 01:20:51 user nova-compute[73458]:         </nova:port>
Aug 27 01:20:51 user nova-compute[73458]:       </nova:ports>
Aug 27 01:20:51 user nova-compute[73458]:     </nova:instance>
Aug 27 01:20:51 user nova-compute[73458]:   </metadata>
Aug 27 01:20:51 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:20:51 user nova-compute[73458]:     <system>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="serial">8289084b-7977-4511-a59e-2d9a2b46fd9d</entry>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="uuid">8289084b-7977-4511-a59e-2d9a2b46fd9d</entry>
Aug 27 01:20:51 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:20:51 user nova-compute[73458]:     </system>
Aug 27 01:20:51 user nova-compute[73458]:   </sysinfo>
Aug 27 01:20:51 user nova-compute[73458]:   <os>
Aug 27 01:20:51 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:20:51 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:20:51 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:20:51 user nova-compute[73458]:   </os>
Aug 27 01:20:51 user nova-compute[73458]:   <features>
Aug 27 01:20:51 user nova-compute[73458]:     <acpi/>
Aug 27 01:20:51 user nova-compute[73458]:     <apic/>
Aug 27 01:20:51 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:20:51 user nova-compute[73458]:   </features>
Aug 27 01:20:51 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:20:51 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:20:51 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:20:51 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:20:51 user nova-compute[73458]:   </clock>
Aug 27 01:20:51 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:20:51 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:20:51 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:20:51 user nova-compute[73458]:   </cpu>
Aug 27 01:20:51 user nova-compute[73458]:   <devices>
Aug 27 01:20:51 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:20:51 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:20:51 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk"/>
Aug 27 01:20:51 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:20:51 user nova-compute[73458]:     </disk>
Aug 27 01:20:51 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:20:51 user nova-compute[73458]:       <mac address="fa:16:3e:1f:94:26"/>
Aug 27 01:20:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:20:51 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:20:51 user nova-compute[73458]:       <target dev="tapa62c6714-91"/>
Aug 27 01:20:51 user nova-compute[73458]:     </interface>
Aug 27 01:20:51 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:20:51 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/console.log" append="off"/>
Aug 27 01:20:51 user nova-compute[73458]:     </serial>
Aug 27 01:20:51 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:20:51 user nova-compute[73458]:     <video>
Aug 27 01:20:51 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:20:51 user nova-compute[73458]:     </video>
Aug 27 01:20:51 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:20:51 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:20:51 user nova-compute[73458]:     </rng>
Aug 27 01:20:51 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:20:51 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:20:51 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:20:51 user nova-compute[73458]:     </memballoon>
Aug 27 01:20:51 user nova-compute[73458]:   </devices>
Aug 27 01:20:51 user nova-compute[73458]: </domain>
Aug 27 01:20:51 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152561704',display_name='tempest-SnapshotDataIntegrityTests-server-152561704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152561704',id=49,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJllXs3Tazy8UlVF3Q1v+vqV6OUQ1sW7dkNrLbGGBOj1d//car8+U7SDoli9aKzYF+5Au4PiWxAbEFZR+RN8vqgb+uOwD0l0as3M+rUoza2TuHJO6qydPuhVQc5WTieMA==',key_name='tempest-keypair-914303875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='087c2bacaf3c434580685e208b7f8529',ramdisk_id='',reservation_id='r-js07o95e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1339359446',owner_user_name='tempest-SnapshotDataIntegrityTests-1339359446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579b8975446647ad8d4d9bae2aaf819a',uuid=8289084b-7977-4511-a59e-2d9a2b46fd9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converting VIF {"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG os_vif [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa62c6714-91, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa62c6714-91, col_values=(('external_ids', {'iface-id': 'a62c6714-91cd-442b-a127-4529b553db2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:94:26', 'vm-uuid': '8289084b-7977-4511-a59e-2d9a2b46fd9d'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:51 user nova-compute[73458]: INFO os_vif [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91')
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No VIF found with MAC fa:16:3e:1f:94:26, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updated VIF entry in instance network info cache for port a62c6714-91cd-442b-a127-4529b553db2a. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG nova.network.neutron [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-22342714-e516-4bdb-9e86-51e4ac15eed8 req-273a0d3b-4073-4d75-bbe4-4c5e258ed040 service nova] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:52 user nova-compute[73458]: INFO nova.compute.manager [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Detaching volume ebcbae7d-9428-4587-a27e-0e75196d7e3a
Aug 27 01:20:52 user nova-compute[73458]: INFO nova.virt.block_device [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Attempting to driver detach volume ebcbae7d-9428-4587-a27e-0e75196d7e3a from mountpoint /dev/vdb
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Attempting to detach device vdb from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:53 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:53 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:20:53 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:20:53 user nova-compute[73458]:   <serial>ebcbae7d-9428-4587-a27e-0e75196d7e3a</serial>
Aug 27 01:20:53 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:20:53 user nova-compute[73458]: </disk>
Aug 27 01:20:53 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully detached device vdb from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the persistent domain config.
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:20:53 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:20:53 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:20:53 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:20:53 user nova-compute[73458]:   <serial>ebcbae7d-9428-4587-a27e-0e75196d7e3a</serial>
Aug 27 01:20:53 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:20:53 user nova-compute[73458]: </disk>
Aug 27 01:20:53 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] No waiting events found dispatching network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:53 user nova-compute[73458]: WARNING nova.compute.manager [req-48d909db-e968-4188-a207-51a0a727d5e7 req-2ad830b8-6bf2-450b-9e8d-07b2696b1ba7 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received unexpected event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a for instance with vm_state building and task_state spawning.
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Skipping network cache update for instance because it is Building. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099253.4999835, 3059135e-0b8d-4450-ae5a-48bdd15128ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:20:53 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully detached device vdb from instance 3059135e-0b8d-4450-ae5a-48bdd15128ba from the live domain config.
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NBSXVmqe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:20:53 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2606656-81d1-45f2-9a92-27949f2cfba3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec04195-f87f-4001-b4e3-5eca84784083]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:53 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:53 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a (non-flash)
Aug 27 01:20:53 user nova-compute[73458]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:20:53 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786e5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e458d6-068a-46ab-bcec-ca24668d323b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f05e2-30cb-4a28-aaa8-c04c60693318]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aabbd17-c23d-4fba-b713-fbb255879404]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51937b5-3c79-41e8-932d-3cf6db9b9674]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a55fd1-3084-40d9-91e2-998866a59c87]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1ab650-6cf2-4f60-8c52-e81a3a63ff8c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260]
Aug 27 01:20:53 user nova-compute[73458]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a, portal: 172.16.0.220,3260] successful.
Aug 27 01:20:53 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebcbae7d-9428-4587-a27e-0e75196d7e3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16541a-508a-4dbf-974e-4a42e16e430e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] <== disconnect_volume: return (285ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [{"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-3059135e-0b8d-4450-ae5a-48bdd15128ba" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:20:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:20:54 user nova-compute[73458]: DEBUG nova.objects.instance [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'flavor' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:20:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d0cdf369-f052-4e1b-9d4b-9ec4d45beca4 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099255.0676403, 8289084b-7977-4511-a59e-2d9a2b46fd9d => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] VM Resumed (Lifecycle Event)
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Instance spawned successfully.
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] No waiting events found dispatching network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:20:55 user nova-compute[73458]: WARNING nova.compute.manager [req-19cda872-5ac2-4071-b5f3-2535660ecb37 req-aabf2362-bad0-427b-8ca3-72e6732c553a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received unexpected event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a for instance with vm_state building and task_state spawning.
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099255.0709937, 8289084b-7977-4511-a59e-2d9a2b46fd9d => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] VM Started (Lifecycle Event)
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 27 01:20:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:20:55 user nova-compute[73458]: INFO nova.compute.manager [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Took 6.35 seconds to build instance.
Aug 27 01:20:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d87c9b33-2850-4888-afe0-ec9e82ee22e9 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.444s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:20:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:20:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:00 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099245.8454645, 2db50725-3497-4a96-a23f-eee5ab7c46fe => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:21:00 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] VM Stopped (Lifecycle Event)
Aug 27 01:21:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-058d31df-8d5b-4e35-9813-1cc3b95f3bf0 None None] [instance: 2db50725-3497-4a96-a23f-eee5ab7c46fe] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:21:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:21:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:21:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:43 user nova-compute[73458]: INFO nova.compute.manager [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Terminating instance
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-unplugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] No waiting events found dispatching network-vif-unplugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.compute.manager [req-091db323-338c-475c-8fa3-3eab5dabd4ef req-98c4f3b4-c93d-4930-86b3-7c182a1f3e9f service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-unplugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:21:43 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Instance destroyed successfully.
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lazy-loading 'resources' on Instance uuid 3059135e-0b8d-4450-ae5a-48bdd15128ba {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1351340155',display_name='tempest-TestServerVolumeAttachmentScenario-server-1351340155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1351340155',id=44,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgWgmrY3XxXzPOZqCxaGqJbpzWlkRoipez7UPYC/Hr9R8/bfNM6/ksuKqakKQlCuD95nGV8J4r5UyBd2h0l7PSGll6WYkii5V7uFGqzMTOe2VyiAP9+20MnIugCK4uG1A==',key_name='tempest-keypair-1447603292',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:17:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb884168eb4148e19e429673ce353a7c',ramdisk_id='',reservation_id='r-4g67k6g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-666317724',owner_user_name='tempest-TestServerVolumeAttachmentScenario-666317724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff08ca65744a428dad703efc34ba6399',uuid=3059135e-0b8d-4450-ae5a-48bdd15128ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:21:43 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converting VIF {"id": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "address": "fa:16:3e:18:7e:0e", "network": {"id": "e5c08c7b-4e59-4282-94d4-82cec9ad1987", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1792144995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb884168eb4148e19e429673ce353a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32b8a7-6c", "ovs_interfaceid": "ab32b8a7-6c46-4b89-9137-cd7f5ca86d75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG os_vif [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab32b8a7-6c, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:21:44 user nova-compute[73458]: INFO os_vif [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:7e:0e,bridge_name='br-int',has_traffic_filtering=True,id=ab32b8a7-6c46-4b89-9137-cd7f5ca86d75,network=Network(e5c08c7b-4e59-4282-94d4-82cec9ad1987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32b8a7-6c')
Aug 27 01:21:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Deleting instance files /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba_del
Aug 27 01:21:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Deletion of /opt/stack/data/nova/instances/3059135e-0b8d-4450-ae5a-48bdd15128ba_del complete
Aug 27 01:21:44 user nova-compute[73458]: INFO nova.compute.manager [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 01:21:44 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:21:44 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Took 0.79 seconds to deallocate network for instance.
Aug 27 01:21:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-836ff100-aef1-420e-aad5-71b775c8e9d8 req-09ecddb5-cc94-464b-8d97-c059f704087b service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-deleted-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:45 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Deleted allocations for instance 3059135e-0b8d-4450-ae5a-48bdd15128ba
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-bb714b85-2fb8-43e9-9ff0-1c81cbd13998 tempest-TestServerVolumeAttachmentScenario-666317724 tempest-TestServerVolumeAttachmentScenario-666317724-project-member] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.032s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] Acquiring lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] Lock "3059135e-0b8d-4450-ae5a-48bdd15128ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:45 user nova-compute[73458]: DEBUG nova.compute.manager [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] No waiting events found dispatching network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:21:45 user nova-compute[73458]: WARNING nova.compute.manager [req-42d6bbd0-d90e-4f04-9192-32308179d1c6 req-41d2ecc2-a126-4273-a0f4-141f036ab356 service nova] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Received unexpected event network-vif-plugged-ab32b8a7-6c46-4b89-9137-cd7f5ca86d75 for instance with vm_state deleted and task_state None.
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:46 user nova-compute[73458]: INFO nova.compute.manager [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Terminating instance
Aug 27 01:21:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-unplugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] No waiting events found dispatching network-vif-unplugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-3377d9cd-2c7f-492d-a38e-7795f10e791d req-bfa5898f-85f7-45ce-afba-51b1fa2acce4 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-unplugged-711df4d6-febb-4727-9257-8ef14b96f560 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Instance destroyed successfully.
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.objects.instance [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lazy-loading 'resources' on Instance uuid b35272e7-9ef1-4d23-b823-62783489efca {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-547665160',display_name='tempest-VolumesActionsTest-instance-547665160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-547665160',id=47,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:20:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6a2616fd21b4ca583aaf00b569d1242',ramdisk_id='',reservation_id='r-mpyy1p8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1585999825',owner_user_name='tempest-VolumesActionsTest-1585999825-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:20:04Z,user_data=None,user_id='4b6c0a31ff2f452dbd1d22ef6f3e8a82',uuid=b35272e7-9ef1-4d23-b823-62783489efca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converting VIF {"id": "711df4d6-febb-4727-9257-8ef14b96f560", "address": "fa:16:3e:04:5c:08", "network": {"id": "b4002876-ac2e-44be-8812-ba67f22915dd", "bridge": "br-int", "label": "tempest-VolumesActionsTest-875912198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a2616fd21b4ca583aaf00b569d1242", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap711df4d6-fe", "ovs_interfaceid": "711df4d6-febb-4727-9257-8ef14b96f560", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG os_vif [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap711df4d6-fe, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:21:47 user nova-compute[73458]: INFO os_vif [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5c:08,bridge_name='br-int',has_traffic_filtering=True,id=711df4d6-febb-4727-9257-8ef14b96f560,network=Network(b4002876-ac2e-44be-8812-ba67f22915dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap711df4d6-fe')
Aug 27 01:21:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Deleting instance files /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca_del
Aug 27 01:21:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Deletion of /opt/stack/data/nova/instances/b35272e7-9ef1-4d23-b823-62783489efca_del complete
Aug 27 01:21:47 user nova-compute[73458]: INFO nova.compute.manager [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 01:21:47 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:21:47 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:21:48 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Took 0.49 seconds to deallocate network for instance.
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-51ca9b43-cfe6-4107-a215-c4a293a8b26c req-87ab37c1-228f-4922-adfb-14e90ec427db service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-deleted-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.118s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:21:48 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Deleted allocations for instance b35272e7-9ef1-4d23-b823-62783489efca
Aug 27 01:21:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-b14c11c4-3eee-4cc2-8011-72f01766aca4 tempest-VolumesActionsTest-1585999825 tempest-VolumesActionsTest-1585999825-project-member] Lock "b35272e7-9ef1-4d23-b823-62783489efca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:21:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] Acquiring lock "b35272e7-9ef1-4d23-b823-62783489efca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] Lock "b35272e7-9ef1-4d23-b823-62783489efca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] No waiting events found dispatching network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:21:49 user nova-compute[73458]: WARNING nova.compute.manager [req-af6bb1b7-2dee-4bd7-a5e1-8c540791fc3a req-c81fdc2b-58cf-4c45-8197-11ad48e11205 service nova] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Received unexpected event network-vif-plugged-711df4d6-febb-4727-9257-8ef14b96f560 for instance with vm_state deleted and task_state None.
Aug 27 01:21:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:21:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=25.30963134765625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 75772d06-1345-4897-834b-b5cf5b54b19a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:21:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:21:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:21:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:21:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:21:58 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099303.9779117, 3059135e-0b8d-4450-ae5a-48bdd15128ba => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:21:58 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] VM Stopped (Lifecycle Event)
Aug 27 01:21:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-89f9262f-660f-47bc-a804-3db8a32db776 None None] [instance: 3059135e-0b8d-4450-ae5a-48bdd15128ba] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:22:02 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099307.6342783, b35272e7-9ef1-4d23-b823-62783489efca => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:22:02 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: b35272e7-9ef1-4d23-b823-62783489efca] VM Stopped (Lifecycle Event)
Aug 27 01:22:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-699fe32b-a8a1-4958-9ecc-7bcdbb003676 None None] [instance: b35272e7-9ef1-4d23-b823-62783489efca] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:22:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:22:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-changed-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG nova.compute.manager [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing instance network info cache due to event network-changed-86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG nova.network.neutron [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:22:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updated VIF entry in instance network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:22:15 user nova-compute[73458]: DEBUG nova.network.neutron [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:22:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7f93a35b-ed29-40f8-b1a8-e0cd1e2bebb3 req-83ae534f-6e5d-431e-87da-8f20a3a3ac8c service nova] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:22:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:31 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:22:31 user nova-compute[73458]: INFO nova.compute.claims [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Claim successful on node user
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:22:32 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:22:32 user nova-compute[73458]: INFO nova.virt.block_device [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Booting with volume c07c1d56-e4d3-4277-ba7e-b575f9fc8105 at /dev/vda
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.policy [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56a037d33b594c078bd85fa5eafed883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8111339cd39e4794a9fc40649e480c2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.utils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a89a02-4c78-450d-806c-9156c2eac339]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a038c-eed3-44e9-b1b4-f32381e8ca77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cef2a-457c-4b7f-8ad9-475a02007288]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e38b49-a1fc-474d-9f45-d46fe79e75c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:22:32 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:22:32 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7110756f-5b2a-4eb8-87da-a79f048110c8]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG os_brick.utils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating existing volume attachment record: 5aa2d5e2-f041-452a-97e5-328bfcb36f8c {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:32 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Successfully created port: 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Successfully updated port: 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquired lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG nova.compute.manager [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing instance network info cache due to event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] Acquiring lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:22:33 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG nova.network.neutron [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating instance_info_cache with network_info: [{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Releasing lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Instance network_info: |[{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] Acquired lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updated VIF entry in instance network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG nova.network.neutron [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating instance_info_cache with network_info: [{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:22:34 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4c04dac9-84b1-4189-8fe9-9420912047f1 req-01f5fc49-a7c6-46dd-bb09-2799aeb4effd service nova] Releasing lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:22:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-changed-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:22:40 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Refreshing instance network info cache due to event network-changed-a62c6714-91cd-442b-a127-4529b553db2a. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:22:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:22:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:22:40 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Refreshing network info cache for port a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:22:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updated VIF entry in instance network info cache for port a62c6714-91cd-442b-a127-4529b553db2a. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:22:41 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:22:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb7844c1-eae5-42b7-90e2-5f6521f9f253 req-2fd78fa9-61f1-4793-acdf-252f58f14b15 service nova] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:22:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:22:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Creating image(s)
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Did not create local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Ensure instance console log exists: /opt/stack/data/nova/instances/eb758af2-5b04-41f0-b5fc-1959b20f9efd/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Start _get_guest_xml network_info=[{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZWmgBOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb758af2-5b04-41f0-b5fc-1959b20f9efd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c07c1d56-e4d3-4277-ba7e-b575f9fc8105', 'serial': 'c07c1d56-e4d3-4277-ba7e-b575f9fc8105'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '5aa2d5e2-f041-452a-97e5-328bfcb36f8c', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:22:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:22:44 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZWmgBOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:22:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:22:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:22:44 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bfe88a-5524-49aa-b2a9-afae0358e46f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:22:44 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ba1475-7644-47a4-b054-51d9d25e9e1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105] added
Aug 27 01:22:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe911ef0-e557-4752-ac69-eb751cf59f03]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ff96d-9aa3-4f5d-86b1-67b09ae8caf3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZWmgBOp {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZWmgBOp" returned: 0 in 0.046s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b922ceb-e8e6-45bf-acda-a694acbbedc8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZWmgBOp'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[339e3ef9-f4a0-45c4-b004-a1748f3709a8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c1fde-24e4-404b-b179-85d2994b6d86]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:22:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4badee3b-af41-4d15-a34a-23535b5e7ada]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260]
Aug 27 01:22:45 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260] successful.
Aug 27 01:22:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8b654-77b5-4ede-adcd-d7377048262a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e36bd8-49d5-4cde-b842-77ee1a5b4734]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:45 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:45 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f703ad-f4f0-4b78-949f-cd214b50d336]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:22:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZWmgBOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23563323136313836', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563323136313836', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610980308',display_name='tempest-TestVolumeBootPattern-server-1610980308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610980308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-u2o0udqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:22:32Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=eb758af2-5b04-41f0-b5fc-1959b20f9efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'pci_devices' on Instance uuid eb758af2-5b04-41f0-b5fc-1959b20f9efd {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:22:46 user nova-compute[73458]:   <uuid>eb758af2-5b04-41f0-b5fc-1959b20f9efd</uuid>
Aug 27 01:22:46 user nova-compute[73458]:   <name>instance-00000032</name>
Aug 27 01:22:46 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:22:46 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:22:46 user nova-compute[73458]:   <metadata>
Aug 27 01:22:46 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:22:46 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:22:46 user nova-compute[73458]:       <nova:name>tempest-TestVolumeBootPattern-server-1610980308</nova:name>
Aug 27 01:22:46 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:22:44</nova:creationTime>
Aug 27 01:22:46 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:22:46 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:22:46 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:22:46 user nova-compute[73458]:       <nova:owner>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:user uuid="56a037d33b594c078bd85fa5eafed883">tempest-TestVolumeBootPattern-1099761153-project-member</nova:user>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:project uuid="8111339cd39e4794a9fc40649e480c2b">tempest-TestVolumeBootPattern-1099761153</nova:project>
Aug 27 01:22:46 user nova-compute[73458]:       </nova:owner>
Aug 27 01:22:46 user nova-compute[73458]:       <nova:ports>
Aug 27 01:22:46 user nova-compute[73458]:         <nova:port uuid="4d5ca6ae-3e20-4e2b-b335-84e9b5a21437">
Aug 27 01:22:46 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 01:22:46 user nova-compute[73458]:         </nova:port>
Aug 27 01:22:46 user nova-compute[73458]:       </nova:ports>
Aug 27 01:22:46 user nova-compute[73458]:     </nova:instance>
Aug 27 01:22:46 user nova-compute[73458]:   </metadata>
Aug 27 01:22:46 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:22:46 user nova-compute[73458]:     <system>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="serial">eb758af2-5b04-41f0-b5fc-1959b20f9efd</entry>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="uuid">eb758af2-5b04-41f0-b5fc-1959b20f9efd</entry>
Aug 27 01:22:46 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:22:46 user nova-compute[73458]:     </system>
Aug 27 01:22:46 user nova-compute[73458]:   </sysinfo>
Aug 27 01:22:46 user nova-compute[73458]:   <os>
Aug 27 01:22:46 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:22:46 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:22:46 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:22:46 user nova-compute[73458]:   </os>
Aug 27 01:22:46 user nova-compute[73458]:   <features>
Aug 27 01:22:46 user nova-compute[73458]:     <acpi/>
Aug 27 01:22:46 user nova-compute[73458]:     <apic/>
Aug 27 01:22:46 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:22:46 user nova-compute[73458]:   </features>
Aug 27 01:22:46 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:22:46 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:22:46 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:22:46 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:22:46 user nova-compute[73458]:   </clock>
Aug 27 01:22:46 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:22:46 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:22:46 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:22:46 user nova-compute[73458]:   </cpu>
Aug 27 01:22:46 user nova-compute[73458]:   <devices>
Aug 27 01:22:46 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:22:46 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:22:46 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:22:46 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:22:46 user nova-compute[73458]:       <serial>c07c1d56-e4d3-4277-ba7e-b575f9fc8105</serial>
Aug 27 01:22:46 user nova-compute[73458]:     </disk>
Aug 27 01:22:46 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:22:46 user nova-compute[73458]:       <mac address="fa:16:3e:bf:c1:6d"/>
Aug 27 01:22:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:22:46 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:22:46 user nova-compute[73458]:       <target dev="tap4d5ca6ae-3e"/>
Aug 27 01:22:46 user nova-compute[73458]:     </interface>
Aug 27 01:22:46 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:22:46 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/eb758af2-5b04-41f0-b5fc-1959b20f9efd/console.log" append="off"/>
Aug 27 01:22:46 user nova-compute[73458]:     </serial>
Aug 27 01:22:46 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:22:46 user nova-compute[73458]:     <video>
Aug 27 01:22:46 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:22:46 user nova-compute[73458]:     </video>
Aug 27 01:22:46 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:22:46 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:22:46 user nova-compute[73458]:     </rng>
Aug 27 01:22:46 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:22:46 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:22:46 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:22:46 user nova-compute[73458]:     </memballoon>
Aug 27 01:22:46 user nova-compute[73458]:   </devices>
Aug 27 01:22:46 user nova-compute[73458]: </domain>
Aug 27 01:22:46 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610980308',display_name='tempest-TestVolumeBootPattern-server-1610980308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610980308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-u2o0udqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:22:32Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=eb758af2-5b04-41f0-b5fc-1959b20f9efd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_vif [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d5ca6ae-3e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d5ca6ae-3e, col_values=(('external_ids', {'iface-id': '4d5ca6ae-3e20-4e2b-b335-84e9b5a21437', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:c1:6d', 'vm-uuid': 'eb758af2-5b04-41f0-b5fc-1959b20f9efd'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:46 user nova-compute[73458]: INFO os_vif [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e')
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] No VIF found with MAC fa:16:3e:bf:c1:6d, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:46 user nova-compute[73458]: INFO nova.compute.manager [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attaching volume 934f52b8-218f-4f1f-8df1-af21978c6525 to /dev/vdb
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.utils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd0365e-787f-448f-94f9-cd3f9aae0a00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb4e793-9c34-4c61-9dd0-3fb39106c769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d13a2e-0063-49d9-a081-24f1cd7a231c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6719f-1fd9-4ae5-85e4-99f59be30c24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:22:46 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:22:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4410b8d-6265-438d-b913-ed57661da824]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG os_brick.utils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:22:46 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating existing volume attachment record: df68222b-e7bf-496e-9b3e-9eb430aa896f {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:22:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] No waiting events found dispatching network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:22:48 user nova-compute[73458]: WARNING nova.compute.manager [req-9c1f51f4-2c5e-4217-889b-951ff09ce61f req-a03c7978-f74d-45b6-81dd-3c7f1855711d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received unexpected event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 for instance with vm_state building and task_state spawning.
Aug 27 01:22:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:48 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:22:49 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8424MB free_disk=25.30667495727539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 75772d06-1345-4897-834b-b5cf5b54b19a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance eb758af2-5b04-41f0-b5fc-1959b20f9efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] No waiting events found dispatching network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:22:50 user nova-compute[73458]: WARNING nova.compute.manager [req-fce0d40a-9ef0-441d-ab9c-1aed6f6a901f req-32aab32f-82f7-43d9-9115-d8fd86cd34f9 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received unexpected event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 for instance with vm_state building and task_state spawning.
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099370.2285311, eb758af2-5b04-41f0-b5fc-1959b20f9efd => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] VM Resumed (Lifecycle Event)
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Instance spawned successfully.
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099370.2538316, eb758af2-5b04-41f0-b5fc-1959b20f9efd => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] VM Started (Lifecycle Event)
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:22:50 user nova-compute[73458]: INFO nova.compute.manager [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Took 18.68 seconds to build instance.
Aug 27 01:22:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7726b5c2-eeff-4ddd-8abf-293db6fa0acb tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.782s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:50 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:22:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:22:55 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 75772d06-1345-4897-834b-b5cf5b54b19a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:22:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:22:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:22:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:22:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:22:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xigZacWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:22:59 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:22:59 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:22:59 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb75764-f14d-4641-b200-017c07b359a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:22:59 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efc56fc-0c97-4e9e-8fa8-dfd24beda271]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525] added
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d107cb3-ef0b-4af3-8700-f2319e7b398b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[398861bf-fefe-409c-b43e-b3384a330ccf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xigZacWy {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xigZacWy" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[708ded66-2d1f-4c8d-a2f6-c50a707392e3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xigZacWy'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcef87-229b-401e-ae3c-5b063365f1a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[70843643-40bb-4e1a-a4f0-5e7c7a196216]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f05a13-ec45-43fa-94cd-ee8947f1e8b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260]
Aug 27 01:22:59 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260] successful.
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a64e28-adc4-4dbe-9938-677d21786ca3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997f109-fae2-4865-ad43-d5509ec82695]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:655d2306-6d93-4328-966b-caaaac1deb70 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)
Aug 27 01:22:59 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21631944-1235-4843-aa07-2c18ad2fbf6d]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:22:59 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xigZacWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:23:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:23:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23339623065316132', 'path': '/dev/sde'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:23:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339623065316132', 'path': '/dev/sde'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:23:00 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:23:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:23:00 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:23:00 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:23:00 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:23:00 user nova-compute[73458]:   <serial>934f52b8-218f-4f1f-8df1-af21978c6525</serial>
Aug 27 01:23:00 user nova-compute[73458]: </disk>
Aug 27 01:23:00 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No VIF found with MAC fa:16:3e:1f:94:26, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7e2f62a6-5157-46e4-be0b-2b2b2e07e304 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.785s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.compute.claims [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Claim successful on node user
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.compute.manager [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Detaching volume 934f52b8-218f-4f1f-8df1-af21978c6525
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.virt.block_device [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attempting to driver detach volume 934f52b8-218f-4f1f-8df1-af21978c6525 from mountpoint /dev/vdb
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Attempting to detach device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:23:35 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:23:35 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:23:35 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:23:35 user nova-compute[73458]:   <serial>934f52b8-218f-4f1f-8df1-af21978c6525</serial>
Aug 27 01:23:35 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:23:35 user nova-compute[73458]: </disk>
Aug 27 01:23:35 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config.
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:23:35 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:23:35 user nova-compute[73458]:   <source dev="/dev/sde"/>
Aug 27 01:23:35 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:23:35 user nova-compute[73458]:   <serial>934f52b8-218f-4f1f-8df1-af21978c6525</serial>
Aug 27 01:23:35 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:23:35 user nova-compute[73458]: </disk>
Aug 27 01:23:35 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:23:35 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Creating image(s)
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "538098d59ec626be72f984be8f3d85df7c624420" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "538098d59ec626be72f984be8f3d85df7c624420" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:35 user nova-compute[73458]: DEBUG nova.policy [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd19531889c27435fb65b15e0586efb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7182f87bfe9b4238b46dcc951bb1be4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099416.2370317, 8289084b-7977-4511-a59e-2d9a2b46fd9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:23:36 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config.
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xigZacWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:23:36 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe793a45-c8af-4c96-b61a-d0f91549c1ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecb303-e16c-499c-9a63-f3389198b62c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 (non-flash)
Aug 27 01:23:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78562050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525'): ({'sde'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Removing single pathed devices sde {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb46970-fadf-42c9-b2bd-5a04832ecffb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[39328cba-89cd-43b1-a080-69bdc4af6694]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flushing IO for device /dev/sde {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.part --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.virt.images [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] 923725ab-3a65-4485-8c1e-3dd27268f504 was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.part /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf21330b-b92a-403b-8730-6c6b141cb6e4]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b444a1-32d1-4412-a2c5-2cc676b03bff]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] SCSI volumes sde have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc3f552-dc3b-452e-b49d-3c0f9d26ef0a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Successfully created port: f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.part /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.converted" returned: 0 in 0.230s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f832f2-544d-4b34-bfb1-0b7368f9397b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260]
Aug 27 01:23:36 user nova-compute[73458]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525, portal: 172.16.0.220,3260] successful.
Aug 27 01:23:36 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:934f52b8-218f-4f1f-8df1-af21978c6525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340419b-be2d-475d-8dd1-400d37de9672]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== disconnect_volume: return (443ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "538098d59ec626be72f984be8f3d85df7c624420" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.013s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json" returned: 0 in 0.179s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "538098d59ec626be72f984be8f3d85df7c624420" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "538098d59ec626be72f984be8f3d85df7c624420" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420,backing_fmt=raw /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420,backing_fmt=raw /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk 1073741824" returned: 0 in 0.056s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "538098d59ec626be72f984be8f3d85df7c624420" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Successfully updated port: f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.compute.manager [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing instance network info cache due to event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Cannot resize image /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Ensure instance console log exists: /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-35c31ff1-c279-4268-bf66-c49bb297a45b req-db41bde2-379d-4450-89c1-834735c3dd56 service nova] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:23:37 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.network.neutron [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance network_info: |[{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start _get_guest_xml network_info=[{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T01:23:32Z,direct_url=<?>,disk_format='qcow2',id=923725ab-3a65-4485-8c1e-3dd27268f504,min_disk=0,min_ram=0,name='tempest-scenario-img--1435730255',owner='7182f87bfe9b4238b46dcc951bb1be4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T01:23:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '923725ab-3a65-4485-8c1e-3dd27268f504'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:23:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:23:38 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T01:23:32Z,direct_url=<?>,disk_format='qcow2',id=923725ab-3a65-4485-8c1e-3dd27268f504,min_disk=0,min_ram=0,name='tempest-scenario-img--1435730255',owner='7182f87bfe9b4238b46dcc951bb1be4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T01:23:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:23:36Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'pci_devices' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:23:38 user nova-compute[73458]:   <uuid>dc49a63b-676f-46ce-9d2e-9687b7c0a1db</uuid>
Aug 27 01:23:38 user nova-compute[73458]:   <name>instance-00000033</name>
Aug 27 01:23:38 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:23:38 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:23:38 user nova-compute[73458]:   <metadata>
Aug 27 01:23:38 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:23:38 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:name>tempest-TestMinimumBasicScenario-server-975264753</nova:name>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:23:38</nova:creationTime>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:23:38 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:23:38 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:owner>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:user uuid="d19531889c27435fb65b15e0586efb9e">tempest-TestMinimumBasicScenario-1394839998-project-member</nova:user>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:project uuid="7182f87bfe9b4238b46dcc951bb1be4c">tempest-TestMinimumBasicScenario-1394839998</nova:project>
Aug 27 01:23:38 user nova-compute[73458]:       </nova:owner>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:root type="image" uuid="923725ab-3a65-4485-8c1e-3dd27268f504"/>
Aug 27 01:23:38 user nova-compute[73458]:       <nova:ports>
Aug 27 01:23:38 user nova-compute[73458]:         <nova:port uuid="f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74">
Aug 27 01:23:38 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:23:38 user nova-compute[73458]:         </nova:port>
Aug 27 01:23:38 user nova-compute[73458]:       </nova:ports>
Aug 27 01:23:38 user nova-compute[73458]:     </nova:instance>
Aug 27 01:23:38 user nova-compute[73458]:   </metadata>
Aug 27 01:23:38 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:23:38 user nova-compute[73458]:     <system>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="serial">dc49a63b-676f-46ce-9d2e-9687b7c0a1db</entry>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="uuid">dc49a63b-676f-46ce-9d2e-9687b7c0a1db</entry>
Aug 27 01:23:38 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:23:38 user nova-compute[73458]:     </system>
Aug 27 01:23:38 user nova-compute[73458]:   </sysinfo>
Aug 27 01:23:38 user nova-compute[73458]:   <os>
Aug 27 01:23:38 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:23:38 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:23:38 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:23:38 user nova-compute[73458]:   </os>
Aug 27 01:23:38 user nova-compute[73458]:   <features>
Aug 27 01:23:38 user nova-compute[73458]:     <acpi/>
Aug 27 01:23:38 user nova-compute[73458]:     <apic/>
Aug 27 01:23:38 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:23:38 user nova-compute[73458]:   </features>
Aug 27 01:23:38 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:23:38 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:23:38 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:23:38 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:23:38 user nova-compute[73458]:   </clock>
Aug 27 01:23:38 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:23:38 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:23:38 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:23:38 user nova-compute[73458]:   </cpu>
Aug 27 01:23:38 user nova-compute[73458]:   <devices>
Aug 27 01:23:38 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:23:38 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:23:38 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk"/>
Aug 27 01:23:38 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:23:38 user nova-compute[73458]:     </disk>
Aug 27 01:23:38 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:23:38 user nova-compute[73458]:       <mac address="fa:16:3e:de:23:99"/>
Aug 27 01:23:38 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:23:38 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:23:38 user nova-compute[73458]:       <target dev="tapf04d1ccd-4e"/>
Aug 27 01:23:38 user nova-compute[73458]:     </interface>
Aug 27 01:23:38 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:23:38 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/console.log" append="off"/>
Aug 27 01:23:38 user nova-compute[73458]:     </serial>
Aug 27 01:23:38 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:23:38 user nova-compute[73458]:     <video>
Aug 27 01:23:38 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:23:38 user nova-compute[73458]:     </video>
Aug 27 01:23:38 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:23:38 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:23:38 user nova-compute[73458]:     </rng>
Aug 27 01:23:38 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:23:38 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:23:38 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:23:38 user nova-compute[73458]:     </memballoon>
Aug 27 01:23:38 user nova-compute[73458]:   </devices>
Aug 27 01:23:38 user nova-compute[73458]: </domain>
Aug 27 01:23:38 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:23:36Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG os_vif [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04d1ccd-4e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf04d1ccd-4e, col_values=(('external_ids', {'iface-id': 'f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:23:99', 'vm-uuid': 'dc49a63b-676f-46ce-9d2e-9687b7c0a1db'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:38 user nova-compute[73458]: INFO os_vif [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e')
Aug 27 01:23:38 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:23:38 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No VIF found with MAC fa:16:3e:de:23:99, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:39 user nova-compute[73458]: DEBUG nova.compute.manager [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:23:39 user nova-compute[73458]: WARNING nova.compute.manager [req-90cb1d84-b71c-4b05-82b9-8d6e8857257f req-a456a458-db29-4038-a4f5-906a305fface service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state building and task_state spawning.
Aug 27 01:23:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099421.7562015, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] VM Resumed (Lifecycle Event)
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance spawned successfully.
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099421.758264, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] VM Started (Lifecycle Event)
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:23:41 user nova-compute[73458]: WARNING nova.compute.manager [req-5a4f4c5e-913e-48e1-8385-60a69d7729b8 req-cd7e54c3-ff92-49a4-b371-27e147158421 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state building and task_state spawning.
Aug 27 01:23:41 user nova-compute[73458]: INFO nova.compute.manager [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Took 6.77 seconds to build instance.
Aug 27 01:23:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-77a8589f-c16e-43f6-84bf-5878ed3e1c11 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:23:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e1153d94-3280-46f8-a527-a89f014c2524 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.235s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:49 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:23:50 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:23:50 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=25.232654571533203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 75772d06-1345-4897-834b-b5cf5b54b19a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance eb758af2-5b04-41f0-b5fc-1959b20f9efd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:23:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:23:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:23:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:23:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:23:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:23:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:23:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:23:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Verify base images {{(pid=73458) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Image id 923725ab-3a65-4485-8c1e-3dd27268f504 yields fingerprint 538098d59ec626be72f984be8f3d85df7c624420 {{(pid=73458) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] image 923725ab-3a65-4485-8c1e-3dd27268f504 at (/opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420): checking
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] image 923725ab-3a65-4485-8c1e-3dd27268f504 at (/opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420): image is in use {{(pid=73458) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73458) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Image id 8d38b8b6-6075-47a6-bfce-08caf5b910c3 yields fingerprint 2c6c227bf55330e3d87e9319851c24e42e1c87b0 {{(pid=73458) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] image 8d38b8b6-6075-47a6-bfce-08caf5b910c3 at (/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0): checking
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] image 8d38b8b6-6075-47a6-bfce-08caf5b910c3 at (/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0): image is in use {{(pid=73458) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] 75772d06-1345-4897-834b-b5cf5b54b19a is a valid instance name {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] eb758af2-5b04-41f0-b5fc-1959b20f9efd is a valid instance name {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] 8289084b-7977-4511-a59e-2d9a2b46fd9d is a valid instance name {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] 8289084b-7977-4511-a59e-2d9a2b46fd9d has a disk file {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d is backed by 2c6c227bf55330e3d87e9319851c24e42e1c87b0 {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] dc49a63b-676f-46ce-9d2e-9687b7c0a1db is a valid instance name {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] dc49a63b-676f-46ce-9d2e-9687b7c0a1db has a disk file {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db is backed by 538098d59ec626be72f984be8f3d85df7c624420 {{(pid=73458) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd
Aug 27 01:24:14 user nova-compute[73458]: WARNING nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Unknown base file: /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Active base files: /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Removable base files: /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33 /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31 /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05 /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7c0589b385972f9be800f37a529c2d57cfc27f33
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/85524c5bc6f8d5890bcb983e1ad6766ea1173b7c
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3cb4732bb60ad7614cb56a6810201b4af599332a
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/684ba802c77c3ae1d222e6511868018eca6c9f31
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/94d7a9dd8d778e4f6b92f2e475a00469e630bc05
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d5dd7ac48232237b184d6e82d8432dcf1eb49ebd
Aug 27 01:24:14 user nova-compute[73458]: INFO nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c5d1422b07fdc5391d5cfd992993f25f9083786c
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Verification complete {{(pid=73458) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Verify swap images {{(pid=73458) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 27 01:24:14 user nova-compute[73458]: DEBUG nova.virt.libvirt.imagecache [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Verify ephemeral images {{(pid=73458) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 27 01:24:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG nova.compute.manager [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing instance network info cache due to event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] Acquiring lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] Acquired lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:24:23 user nova-compute[73458]: DEBUG nova.network.neutron [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:24:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updated VIF entry in instance network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:24:24 user nova-compute[73458]: DEBUG nova.network.neutron [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating instance_info_cache with network_info: [{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:24:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-c698a230-0e8e-4a32-8811-d65705a6af11 req-60b8bf64-1565-41e2-93c5-b1ab230c448f service nova] Releasing lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:24:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG nova.compute.manager [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing instance network info cache due to event network-changed-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] Acquiring lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] Acquired lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG nova.network.neutron [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Refreshing network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:25 user nova-compute[73458]: INFO nova.compute.manager [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Terminating instance
Aug 27 01:24:25 user nova-compute[73458]: DEBUG nova.compute.manager [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-unplugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] No waiting events found dispatching network-vif-unplugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.compute.manager [req-a60e95a0-1236-4562-937f-82e47c10276d req-1a41d0cb-a048-4338-934e-d8bd6f176fbd service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-unplugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:24:26 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Instance destroyed successfully.
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid eb758af2-5b04-41f0-b5fc-1959b20f9efd {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:22:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1610980308',display_name='tempest-TestVolumeBootPattern-server-1610980308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1610980308',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:22:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-u2o0udqq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:22:50Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=eb758af2-5b04-41f0-b5fc-1959b20f9efd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_vif [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d5ca6ae-3e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:24:26 user nova-compute[73458]: INFO os_vif [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:c1:6d,bridge_name='br-int',has_traffic_filtering=True,id=4d5ca6ae-3e20-4e2b-b335-84e9b5a21437,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5ca6ae-3e')
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZWmgBOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:24:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[249982a8-54f4-4cdb-8c81-16a5c07aec0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef62f22-e479-4337-8c25-6dea9c0884f5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:26 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:24:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:26 user nova-compute[73458]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 (non-flash)
Aug 27 01:24:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e785192d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[90597167-0951-4aaf-902d-ae9088b0532c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09e6ab-84b0-4ab1-9486-9ec62b7fc48f]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updated VIF entry in instance network info cache for port 4d5ca6ae-3e20-4e2b-b335-84e9b5a21437. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG nova.network.neutron [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating instance_info_cache with network_info: [{"id": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "address": "fa:16:3e:bf:c1:6d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5ca6ae-3e", "ovs_interfaceid": "4d5ca6ae-3e20-4e2b-b335-84e9b5a21437", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.108s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef788aa-85da-4756-a96d-44900d8979a0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5c2c9bae-f114-48cb-a478-1f50ac67ca1e req-63033c7a-64af-425c-910b-1c994f76c44d service nova] Releasing lock "refresh_cache-eb758af2-5b04-41f0-b5fc-1959b20f9efd" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2271e83d-5a82-4575-a31e-da5df11d1764]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO68249ecc-5c2161864f2f7e9a', '/dev/disk/by-id/scsi-23563323136313836', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_68249ecc') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:24:26 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO68249ecc-5c2161864f2f7e9a
Aug 27 01:24:26 user nova-compute[73458]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23563323136313836
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f9074-819b-40c3-bcad-44700db9d13a]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:24:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7216fb-b1d6-4df4-8ea1-01c7737a4d53]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5580cc-8d0e-4037-9662-6e59ea8608c0]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260]
Aug 27 01:24:27 user nova-compute[73458]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105, portal: 172.16.0.220,3260] successful.
Aug 27 01:24:27 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c07c1d56-e4d3-4277-ba7e-b575f9fc8105 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f368ca-5bdf-4866-af28-8c1c413e17ec]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (390ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:24:27 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Deleting instance files /opt/stack/data/nova/instances/eb758af2-5b04-41f0-b5fc-1959b20f9efd_del
Aug 27 01:24:27 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Deletion of /opt/stack/data/nova/instances/eb758af2-5b04-41f0-b5fc-1959b20f9efd_del complete
Aug 27 01:24:27 user nova-compute[73458]: INFO nova.compute.manager [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 27 01:24:27 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:24:27 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:24:27 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Took 0.60 seconds to deallocate network for instance.
Aug 27 01:24:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] Acquiring lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] No waiting events found dispatching network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:24:28 user nova-compute[73458]: WARNING nova.compute.manager [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received unexpected event network-vif-plugged-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 for instance with vm_state active and task_state deleting.
Aug 27 01:24:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-510ffc20-7684-41ce-babf-3e68dc1f9435 req-ca240a9c-4adb-4070-bf80-01be3e0a2037 service nova] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Received event network-vif-deleted-4d5ca6ae-3e20-4e2b-b335-84e9b5a21437 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:24:28 user nova-compute[73458]: INFO nova.compute.manager [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Took 0.76 seconds to detach 1 volumes for instance.
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:28 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance eb758af2-5b04-41f0-b5fc-1959b20f9efd
Aug 27 01:24:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dadfa23e-3bbb-477a-a81b-f0f2f626725c tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "eb758af2-5b04-41f0-b5fc-1959b20f9efd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:29 user nova-compute[73458]: INFO nova.compute.manager [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attaching volume e159bb1f-2df9-42d7-80a9-4a75657e512a to /dev/vdb
Aug 27 01:24:29 user nova-compute[73458]: DEBUG os_brick.utils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2056b1-4779-4097-83a1-9269260d4679]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3e39d-a91d-4b5c-bfbc-7eb6f0fda473]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:29 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ebfd9c-47ec-4632-bb39-99510a1da54c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b958c-8f80-4a0f-9926-c5bbef12a2df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:24:30 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:24:30 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbf615-fc9a-43c8-b7f1-a06bea49159d]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG os_brick.utils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:24:30 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating existing volume attachment record: 61e0c6ea-859f-4216-b0d5-06be801d6c68 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:24:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLRlWFyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:24:40 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:24:40 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:24:40 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c6c1c3-c4ef-4530-847f-e8edffa70f29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:24:40 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47dac2b-21d4-4133-9b38-7505179f1c19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a] added
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db23b632-afdc-4c9c-8566-8a5114701dec]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f8583-e107-477a-9444-e53dbebf032d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLRlWFyz {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bLRlWFyz" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b2f79-af8f-4747-9f2b-9cc381e1507f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bLRlWFyz'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efce82c-ba3f-4656-8214-a4094e8ba8b6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ec579-6806-4018-b9de-33770550eff6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8895b1c-a5ab-430d-9779-47f746103ae2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260]
Aug 27 01:24:40 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260] successful.
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b2b214-3ad1-41f9-8648-5d052f4d8c46]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f763f73-07a9-445b-9515-33b8a0c58d0f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:40 user nova-compute[73458]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:40 user nova-compute[73458]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)
Aug 27 01:24:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28127aa-f1c2-47eb-9364-e144e6e21bfb]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099466.6714752, eb758af2-5b04-41f0-b5fc-1959b20f9efd => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:24:41 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] VM Stopped (Lifecycle Event)
Aug 27 01:24:41 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0bcc9d0d-cb0b-445f-8f05-54b802129ed7 None None] [instance: eb758af2-5b04-41f0-b5fc-1959b20f9efd] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLRlWFyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26131623064393661', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131623064393661', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG nova.objects.instance [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:24:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:24:41 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:24:41 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:24:41 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:24:41 user nova-compute[73458]:   <serial>e159bb1f-2df9-42d7-80a9-4a75657e512a</serial>
Aug 27 01:24:41 user nova-compute[73458]: </disk>
Aug 27 01:24:41 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:24:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:24:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:24:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No VIF found with MAC fa:16:3e:1f:94:26, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:24:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-4ae91cd3-7498-4f64-acc4-59611d57a41f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.680s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:44 user nova-compute[73458]: INFO nova.compute.manager [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Detaching volume e159bb1f-2df9-42d7-80a9-4a75657e512a
Aug 27 01:24:44 user nova-compute[73458]: INFO nova.virt.block_device [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attempting to driver detach volume e159bb1f-2df9-42d7-80a9-4a75657e512a from mountpoint /dev/vdb
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Attempting to detach device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:24:44 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:24:44 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:24:44 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:24:44 user nova-compute[73458]:   <serial>e159bb1f-2df9-42d7-80a9-4a75657e512a</serial>
Aug 27 01:24:44 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:24:44 user nova-compute[73458]: </disk>
Aug 27 01:24:44 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:24:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config.
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:24:44 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:24:44 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:24:44 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:24:44 user nova-compute[73458]:   <serial>e159bb1f-2df9-42d7-80a9-4a75657e512a</serial>
Aug 27 01:24:44 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:24:44 user nova-compute[73458]: </disk>
Aug 27 01:24:44 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099484.8275783, 8289084b-7977-4511-a59e-2d9a2b46fd9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:24:44 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config.
Aug 27 01:24:44 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bLRlWFyz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:24:44 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedb0b40-15c4-432f-ad7a-dd6cb59561f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f9f18d-586a-4736-b1f9-d8554afbd4b0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:44 user nova-compute[73458]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)
Aug 27 01:24:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:24:44 user nova-compute[73458]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a (non-flash)
Aug 27 01:24:44 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9038c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369f849-186e-4201-8582-afd9ff0005b9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9eb08-2905-42ff-9506-60cecb940ed0]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9108319e-b2d1-4863-a8e3-bb34804cb278]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:24:44 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aab2305-4c86-4c44-927e-305819d118d4]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f0caa-15b3-4cea-93b9-ea12dc19476e]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ad50f1-dcff-47be-a5b5-9f38f7f4dd57]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260]
Aug 27 01:24:45 user nova-compute[73458]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a, portal: 172.16.0.220,3260] successful.
Aug 27 01:24:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e159bb1f-2df9-42d7-80a9-4a75657e512a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb99d12-db23-4988-951e-a05b888ba6fe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== disconnect_volume: return (272ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG nova.objects.instance [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:24:45 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-cc97447d-fa8a-41ba-a6b3-d2182eb19261 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.624s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:50 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:24:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:24:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=25.20336151123047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 75772d06-1345-4897-834b-b5cf5b54b19a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:24:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:24:53 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:24:53 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:24:53 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:24:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:24:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:24:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:24:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:24:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:24:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:25:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:16 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:25:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:25:26 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-changed-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing instance network info cache due to event network-changed-86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] Acquiring lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] Acquired lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG nova.network.neutron [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Refreshing network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:30 user nova-compute[73458]: INFO nova.compute.manager [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Terminating instance
Aug 27 01:25:30 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updated VIF entry in instance network info cache for port 86eb481a-763d-470b-bf61-9b600084ac99. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [{"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66f5fff7-3933-4c98-afe2-a2a03ff1b43f req-99e17759-8a4e-4f8b-9070-e799fcca9cdd service nova] Releasing lock "refresh_cache-75772d06-1345-4897-834b-b5cf5b54b19a" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:31 user nova-compute[73458]: INFO nova.compute.manager [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Attaching volume f8c5fa54-9a59-4c9e-953c-31b78845c29d to /dev/vdb
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.utils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ae2954-c2ad-4537-89a0-3cff28f6d038]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9a1d8-1a63-4334-bcd9-d5e3fbd6b11e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[41393914-f2b5-4599-ad27-9dfef388d088]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b04157-5793-4f29-83a2-83d31ce825bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Instance destroyed successfully.
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lazy-loading 'resources' on Instance uuid 75772d06-1345-4897-834b-b5cf5b54b19a {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:25:31 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83066d5-d84d-45aa-bd22-e747f123174f]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.utils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating existing volume attachment record: a3b66b67-d48a-45c7-aecc-cec2d0267ce0 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1068345530',display_name='tempest-TestVolumeBootPattern-server-1068345530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1068345530',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkRfAlLVIadMVPdR6eyQaAcA8+qqgAyPWpGzTvn7FCn2NEn4rTCmZGxh2aUkxG3gF2ElVGgzAyMiaAJ83b+/WKL5CGriz23swLttJVffeaE+EnF39PwXcpIE6hoVZkeYw==',key_name='tempest-TestVolumeBootPattern-1894459407',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8111339cd39e4794a9fc40649e480c2b',ramdisk_id='',reservation_id='r-9t20upqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1099761153',owner_user_name='tempest-TestVolumeBootPattern-1099761153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:20:41Z,user_data=None,user_id='56a037d33b594c078bd85fa5eafed883',uuid=75772d06-1345-4897-834b-b5cf5b54b19a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converting VIF {"id": "86eb481a-763d-470b-bf61-9b600084ac99", "address": "fa:16:3e:c4:50:1d", "network": {"id": "13f73ed4-8433-4a50-9b49-03ed98e2b4e2", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-333301264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8111339cd39e4794a9fc40649e480c2b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb481a-76", "ovs_interfaceid": "86eb481a-763d-470b-bf61-9b600084ac99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_vif [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86eb481a-76, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:31 user nova-compute[73458]: INFO os_vif [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:50:1d,bridge_name='br-int',has_traffic_filtering=True,id=86eb481a-763d-470b-bf61-9b600084ac99,network=Network(13f73ed4-8433-4a50-9b49-03ed98e2b4e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb481a-76')
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVqGxUim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:25:31 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbdf942-85aa-4927-9381-293134d4260a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4e29b-587f-449c-ae4c-e3e9a9b222f3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:25:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 (non-flash)
Aug 27 01:25:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9031dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7'): ({'sdd'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Removing single pathed devices sdd {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[215863d8-4a8f-46d3-85bc-958a54ddd492]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4451fd85-ee5c-4385-90af-8332d3429a16]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Flushing IO for device /dev/sdd {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef67bdb-cb85-4364-ad93-1f2cbef20075]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2e550-b05a-4c5a-8551-24bc9a9428aa]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] SCSI volumes sdd have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe66df42-94249ea8a11cbfa6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e66df42', '/dev/disk/by-id/scsi-23934323439656138') {{(pid=84129) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f236a59-ab23-45c1-924b-339f78928a55]: (4, None) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad689bb-0e52-45a7-8fea-6b639cb6c228]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd5024-7afa-418b-b1fc-ad0ca8ce63cf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260]
Aug 27 01:25:31 user nova-compute[73458]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7, portal: 172.16.0.220,3260] successful.
Aug 27 01:25:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1df90b5a-c563-44a4-bcb5-c5a2eb63ace7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f1a3f-fbe4-4783-9b8a-2c1245d21596]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] <== disconnect_volume: return (291ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:25:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Deleting instance files /opt/stack/data/nova/instances/75772d06-1345-4897-834b-b5cf5b54b19a_del
Aug 27 01:25:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Deletion of /opt/stack/data/nova/instances/75772d06-1345-4897-834b-b5cf5b54b19a_del complete
Aug 27 01:25:31 user nova-compute[73458]: INFO nova.compute.manager [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 27 01:25:31 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:25:31 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:25:32 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Took 0.51 seconds to deallocate network for instance.
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-4848b6e7-cd0f-4e54-a30a-a1a99ad04d1d req-412b4c3e-d138-4d7c-bcb7-d6f0d3e7ba47 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-deleted-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-unplugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] No waiting events found dispatching network-vif-unplugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-unplugged-86eb481a-763d-470b-bf61-9b600084ac99 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Acquiring lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] Lock "75772d06-1345-4897-834b-b5cf5b54b19a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:32 user nova-compute[73458]: DEBUG nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] No waiting events found dispatching network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:25:32 user nova-compute[73458]: WARNING nova.compute.manager [req-70b3f457-47ab-4d47-87a8-9ce38139ffe5 req-2a5cf93e-a740-4c78-a14d-f7c285141080 service nova] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Received unexpected event network-vif-plugged-86eb481a-763d-470b-bf61-9b600084ac99 for instance with vm_state active and task_state deleting.
Aug 27 01:25:33 user nova-compute[73458]: INFO nova.compute.manager [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Took 0.75 seconds to detach 1 volumes for instance.
Aug 27 01:25:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:25:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:33 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Deleted allocations for instance 75772d06-1345-4897-834b-b5cf5b54b19a
Aug 27 01:25:33 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7a7dbff0-f90f-45da-b6cd-1fa677dad123 tempest-TestVolumeBootPattern-1099761153 tempest-TestVolumeBootPattern-1099761153-project-member] Lock "75772d06-1345-4897-834b-b5cf5b54b19a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:38 user nova-compute[73458]: INFO nova.compute.manager [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attaching volume f6732bc4-71f5-459b-89b5-9ed9ea339310 to /dev/vdb
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.utils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a08596-7a30-4cec-afb8-09753d8a5b70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b6d8d-52c9-438f-b10f-e4f1a4ecb1ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c42e21-798c-4479-a1c3-ab7638e957f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b38e9-1a26-4c2f-8f47-41af9c64da96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:25:38 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:25:38 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e8535-f0ae-4d62-9dc7-a3643b1e5c24]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG os_brick.utils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:25:38 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating existing volume attachment record: 98a5fde5-e9d7-4b90-b476-00cb35099764 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:25:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:25:41 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:25:41 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:25:41 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f20818-f624-4acc-9a9b-a8c157d4fe87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:25:41 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9119f6c1-4476-4a5d-afb4-fb03e4b63acb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d] added
Aug 27 01:25:41 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1761e4-bd3f-4112-a50e-acbe4c842307]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c99f45-c7c9-4cd6-a1a4-1ff444a96d69]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:41 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPaLjsXu {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPaLjsXu" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932e5f3-1dc8-4c6e-95c5-b68c7c2807f3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rPaLjsXu'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0d884-6cc0-484f-971a-0ece3908c577]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697b098-0801-4ca9-9fd7-657158070b6f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:25:42 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:25:42 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:25:42 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:25:42 user nova-compute[73458]: 
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4ff38-166b-4d3d-9c3d-b914e11801bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]
Aug 27 01:25:42 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.
Aug 27 01:25:42 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf385efa-20c0-4ecc-be03-7a5604832b8c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ff31b-7fb8-4a70-b569-4fab26ee66f2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:42 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:42 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a560d5-820d-4323-86fc-a8010ac53469]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:25:42 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23864313366643663', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313366643663', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.objects.instance [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:25:43 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:25:43 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:25:43 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:25:43 user nova-compute[73458]:   <serial>f8c5fa54-9a59-4c9e-953c-31b78845c29d</serial>
Aug 27 01:25:43 user nova-compute[73458]: </disk>
Aug 27 01:25:43 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No VIF found with MAC fa:16:3e:de:23:99, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-63bd81b0-679c-49d3-8a50-2f09cd1b22a3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.528s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.980s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099531.4392753, 75772d06-1345-4897-834b-b5cf5b54b19a => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:25:46 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] VM Stopped (Lifecycle Event)
Aug 27 01:25:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-9fcc4462-c6ec-477c-9078-a6e868e46018 None None] [instance: 75772d06-1345-4897-834b-b5cf5b54b19a] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:25:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:51 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:25:52 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.201766967773438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:25:52 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:53 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKlLcreT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:25:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:25:54 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:25:54 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514a5d7-49a8-4ccc-82f9-97d9cd9dd759]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:25:54 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f437590-db80-404c-9475-1323c90001a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310] added
Aug 27 01:25:54 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb9550-3cdd-4064-8350-ae7388eb5bbe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8cc79a-843a-41bd-a99f-b8336332c4a3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKlLcreT {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKlLcreT" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b2773-57fd-44af-af96-ae2093ffb6e5]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKlLcreT'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc65f4-c790-44ae-a9b6-c04cb2b4a361]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedf7355-f308-4725-99d8-521e7eb62fed]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478df6a-8aaf-4411-bb32-9459390b0984]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260]
Aug 27 01:25:55 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260] successful.
Aug 27 01:25:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3fd88-e6da-40dd-9a78-e372f02f6975]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbafc5ba-d72f-4db1-8784-edac8ab5e510]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:55 user nova-compute[73458]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)
Aug 27 01:25:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:25:55 user nova-compute[73458]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)
Aug 27 01:25:55 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fa29c-cc95-4f56-af5e-ce234d30c014]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:25:55 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKlLcreT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23231643838353463', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231643838353463', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:25:56 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:25:56 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:25:56 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:25:56 user nova-compute[73458]:   <serial>f6732bc4-71f5-459b-89b5-9ed9ea339310</serial>
Aug 27 01:25:56 user nova-compute[73458]: </disk>
Aug 27 01:25:56 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No VIF found with MAC fa:16:3e:1f:94:26, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:25:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0405da56-4258-4b31-b924-d24aed6859e8 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.325s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:25:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:25:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:25:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:25:59 user nova-compute[73458]: INFO nova.compute.manager [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Detaching volume f6732bc4-71f5-459b-89b5-9ed9ea339310
Aug 27 01:25:59 user nova-compute[73458]: INFO nova.virt.block_device [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attempting to driver detach volume f6732bc4-71f5-459b-89b5-9ed9ea339310 from mountpoint /dev/vdb
Aug 27 01:25:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Attempting to detach device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:25:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:25:59 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:25:59 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:25:59 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:25:59 user nova-compute[73458]:   <serial>f6732bc4-71f5-459b-89b5-9ed9ea339310</serial>
Aug 27 01:25:59 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:25:59 user nova-compute[73458]: </disk>
Aug 27 01:25:59 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:25:59 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config.
Aug 27 01:25:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:25:59 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:25:59 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:25:59 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:25:59 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:25:59 user nova-compute[73458]:   <serial>f6732bc4-71f5-459b-89b5-9ed9ea339310</serial>
Aug 27 01:25:59 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:25:59 user nova-compute[73458]: </disk>
Aug 27 01:25:59 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:25:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099560.011134, 8289084b-7977-4511-a59e-2d9a2b46fd9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:26:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config.
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKlLcreT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:26:00 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec8600-5c87-4de6-9fd1-11207965c361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21771149-7dc6-4eb8-8339-942598338962]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:00 user nova-compute[73458]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)
Aug 27 01:26:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:00 user nova-compute[73458]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 (non-flash)
Aug 27 01:26:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e786867a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268b608-3fd5-47a5-9db9-ea8d6c0c6a83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd4252-dddc-4361-a82a-2d28a13898be]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58b00c0-a52c-4cf2-b1ee-7b262905cf14]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc4ea9-1df9-4a7f-b3ec-6b4276863acc]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e45941-bbdc-466c-89bc-ed272b18f064]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b50db7-540e-4320-9175-414294b0d01a]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260]
Aug 27 01:26:00 user nova-compute[73458]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310, portal: 172.16.0.220,3260] successful.
Aug 27 01:26:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6732bc4-71f5-459b-89b5-9ed9ea339310 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[98176433-a113-4f49-8f2b-242777b020e6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== disconnect_volume: return (256ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing instance network info cache due to event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:26:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-dda22c2f-e10b-4925-967b-57fcb18b887f tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updated VIF entry in instance network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0a9e227a-16d6-4ddd-90e1-5f12e6845550 req-5aa5b558-3d0c-408b-bc13-ac00c462abd4 service nova] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:26:01 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing instance network info cache due to event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:26:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:26:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:26:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:26:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updated VIF entry in instance network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:26:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:26:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f9e46923-a6cf-4a79-a086-5aa1c78c9bbc req-14ffcce3-9959-456a-a32a-50a3bbf182ef service nova] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:26:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:06 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:10 user nova-compute[73458]: INFO nova.compute.manager [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Rebooting instance
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:10 user nova-compute[73458]: DEBUG nova.compute.manager [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:26:10 user nova-compute[73458]: WARNING nova.compute.manager [req-de7379ac-8b00-4f29-b4fe-b481551c613b req-229ead39-86cc-4211-89c2-483d2277349f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 01:26:11 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance destroyed successfully.
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'resources' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:26:11Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04d1ccd-4e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:26:11 user nova-compute[73458]: INFO os_vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e')
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:26:11 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[00885413-cdeb-483b-bc2d-ee070019190a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa4f31d-195d-40bc-b202-684790fc0a7b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:11 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:11 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e9933b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[149718d2-971d-42a1-91fe-2d794e91b8db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[21850f89-12c5-4f4d-9d80-1bdc1685fcf0]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337e895-5f62-4347-9d0e-6e1f47b4c02b]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a998006-1e56-4341-b0e8-8556e80b56c8]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fd3c74-f2bb-4ec5-8c13-14c7f999ce47]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6cab0-b616-43b6-9bcb-7a6bf5afd8d0]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]
Aug 27 01:26:11 user nova-compute[73458]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.
Aug 27 01:26:11 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d4b08-fdbd-4996-b9e1-f54584db1294]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== disconnect_volume: return (248ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start _get_guest_xml network_info=[{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=923725ab-3a65-4485-8c1e-3dd27268f504,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '923725ab-3a65-4485-8c1e-3dd27268f504'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'dc49a63b-676f-46ce-9d2e-9687b7c0a1db', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8c5fa54-9a59-4c9e-953c-31b78845c29d', 'serial': 'f8c5fa54-9a59-4c9e-953c-31b78845c29d'}, 'guest_format': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'a3b66b67-d48a-45c7-aecc-cec2d0267ce0', 'volume_type': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:26:11 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:26:11 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=923725ab-3a65-4485-8c1e-3dd27268f504,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.objects.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Object Instance<dc49a63b-676f-46ce-9d2e-9687b7c0a1db> lazy-loaded attributes: resources,vcpu_model {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:26:11 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:26:11 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:26:11 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c820ce9-649b-4017-b512-bf1ce2e37d34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:26:11 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5bdcb-dfbb-4782-b8fd-52b674d26b15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d] added
Aug 27 01:26:11 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cc54a-63e0-456e-bbd3-46a4ceda3f6f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e435940-c30a-4bb3-aadb-82f08445088c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPaLjsXu {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rPaLjsXu" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76e36b-98c1-4a19-bdad-e80aa31dc9aa]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rPaLjsXu'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171d258-8727-46c8-bf67-d3180ad7b043]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a119b874-2b12-4b7e-9be1-ff08f71c9123]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:26:11 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:26:11 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:26:11 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:26:11 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:26:11 user nova-compute[73458]: 
Aug 27 01:26:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[156e490d-3b3f-481c-aea4-d96725e90f47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]
Aug 27 01:26:12 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.
Aug 27 01:26:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b40545-5f11-4419-b4d8-cfe373435291]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1748af-349d-449a-aa71-8a9a65d3de4c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:26:12 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c17f83-36ce-43d0-9dd0-e1e443730ad9]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:26:12 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:26:13 user nova-compute[73458]: WARNING nova.compute.manager [req-6441bcfd-4fca-48f0-854b-5bda38650ac3 req-5ea150af-b6f0-4cce-ae4b-04e00a9f1052 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 01:26:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23864313366643663', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313366643663', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:26:11Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'pci_devices' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Object Instance<dc49a63b-676f-46ce-9d2e-9687b7c0a1db> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:26:13 user nova-compute[73458]:   <uuid>dc49a63b-676f-46ce-9d2e-9687b7c0a1db</uuid>
Aug 27 01:26:13 user nova-compute[73458]:   <name>instance-00000033</name>
Aug 27 01:26:13 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:26:13 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:26:13 user nova-compute[73458]:   <metadata>
Aug 27 01:26:13 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:26:13 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:name>tempest-TestMinimumBasicScenario-server-975264753</nova:name>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:26:11</nova:creationTime>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:26:13 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:26:13 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:owner>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:user uuid="d19531889c27435fb65b15e0586efb9e">tempest-TestMinimumBasicScenario-1394839998-project-member</nova:user>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:project uuid="7182f87bfe9b4238b46dcc951bb1be4c">tempest-TestMinimumBasicScenario-1394839998</nova:project>
Aug 27 01:26:13 user nova-compute[73458]:       </nova:owner>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:root type="image" uuid="923725ab-3a65-4485-8c1e-3dd27268f504"/>
Aug 27 01:26:13 user nova-compute[73458]:       <nova:ports>
Aug 27 01:26:13 user nova-compute[73458]:         <nova:port uuid="f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74">
Aug 27 01:26:13 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 01:26:13 user nova-compute[73458]:         </nova:port>
Aug 27 01:26:13 user nova-compute[73458]:       </nova:ports>
Aug 27 01:26:13 user nova-compute[73458]:     </nova:instance>
Aug 27 01:26:13 user nova-compute[73458]:   </metadata>
Aug 27 01:26:13 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:26:13 user nova-compute[73458]:     <system>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="serial">dc49a63b-676f-46ce-9d2e-9687b7c0a1db</entry>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="uuid">dc49a63b-676f-46ce-9d2e-9687b7c0a1db</entry>
Aug 27 01:26:13 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:26:13 user nova-compute[73458]:     </system>
Aug 27 01:26:13 user nova-compute[73458]:   </sysinfo>
Aug 27 01:26:13 user nova-compute[73458]:   <os>
Aug 27 01:26:13 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:26:13 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:26:13 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:26:13 user nova-compute[73458]:   </os>
Aug 27 01:26:13 user nova-compute[73458]:   <features>
Aug 27 01:26:13 user nova-compute[73458]:     <acpi/>
Aug 27 01:26:13 user nova-compute[73458]:     <apic/>
Aug 27 01:26:13 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:26:13 user nova-compute[73458]:   </features>
Aug 27 01:26:13 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:26:13 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:26:13 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:26:13 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:26:13 user nova-compute[73458]:   </clock>
Aug 27 01:26:13 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:26:13 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:26:13 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:26:13 user nova-compute[73458]:   </cpu>
Aug 27 01:26:13 user nova-compute[73458]:   <devices>
Aug 27 01:26:13 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:26:13 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:26:13 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk"/>
Aug 27 01:26:13 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:26:13 user nova-compute[73458]:     </disk>
Aug 27 01:26:13 user nova-compute[73458]:     <disk type="block" device="disk">
Aug 27 01:26:13 user nova-compute[73458]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:26:13 user nova-compute[73458]:       <source dev="/dev/sdb"/>
Aug 27 01:26:13 user nova-compute[73458]:       <target dev="vdb" bus="virtio"/>
Aug 27 01:26:13 user nova-compute[73458]:       <serial>f8c5fa54-9a59-4c9e-953c-31b78845c29d</serial>
Aug 27 01:26:13 user nova-compute[73458]:     </disk>
Aug 27 01:26:13 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:26:13 user nova-compute[73458]:       <mac address="fa:16:3e:de:23:99"/>
Aug 27 01:26:13 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:26:13 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:26:13 user nova-compute[73458]:       <target dev="tapf04d1ccd-4e"/>
Aug 27 01:26:13 user nova-compute[73458]:     </interface>
Aug 27 01:26:13 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:26:13 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/console.log" append="off"/>
Aug 27 01:26:13 user nova-compute[73458]:     </serial>
Aug 27 01:26:13 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:26:13 user nova-compute[73458]:     <video>
Aug 27 01:26:13 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:26:13 user nova-compute[73458]:     </video>
Aug 27 01:26:13 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:26:13 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:26:13 user nova-compute[73458]:     </rng>
Aug 27 01:26:13 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:26:13 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:26:13 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:26:13 user nova-compute[73458]:     </memballoon>
Aug 27 01:26:13 user nova-compute[73458]:   </devices>
Aug 27 01:26:13 user nova-compute[73458]: </domain>
Aug 27 01:26:13 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'trusted_certs' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Object Instance<dc49a63b-676f-46ce-9d2e-9687b7c0a1db> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/538098d59ec626be72f984be8f3d85df7c624420 --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Cannot resize image /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.instance [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'migration_context' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.objects.base [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Object Instance<dc49a63b-676f-46ce-9d2e-9687b7c0a1db> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73458) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:26:11Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG os_vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04d1ccd-4e, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf04d1ccd-4e, col_values=(('external_ids', {'iface-id': 'f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:23:99', 'vm-uuid': 'dc49a63b-676f-46ce-9d2e-9687b7c0a1db'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:26:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:13 user nova-compute[73458]: INFO os_vif [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e')
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:26:15 user nova-compute[73458]: WARNING nova.compute.manager [req-3c6c3909-bf06-4e10-8d94-4f82b590093a req-f8140fde-1cfe-49e7-8506-fc8276b9e093 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for dc49a63b-676f-46ce-9d2e-9687b7c0a1db due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099577.3070734, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:26:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] VM Resumed (Lifecycle Event)
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:26:17 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance rebooted successfully.
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:26:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099577.3084533, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:26:17 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] VM Started (Lifecycle Event)
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-fb79b41b-add5-428b-9136-356fe2de1a52 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.227s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:17 user nova-compute[73458]: DEBUG nova.compute.manager [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:26:17 user nova-compute[73458]: WARNING nova.compute.manager [req-ffb62cbb-cfa7-40e2-9a1d-7229959cf9ed req-f215ffc5-d29f-461b-ae9a-4529d026916c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state active and task_state None.
Aug 27 01:26:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:26:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:36 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:44 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:52 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:52 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:53 user nova-compute[73458]: INFO nova.compute.manager [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attaching volume 58f5a328-d465-496d-96a7-734942b3f87f to /dev/vdb
Aug 27 01:26:53 user nova-compute[73458]: DEBUG os_brick.utils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28d6dba-83c9-405e-8648-9c3c6e644249]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f626482-0a1a-4581-974d-8f24faf5868a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f910822-0ae7-4b12-bb8f-cfdd5d6f9b77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc98131a-c478-4832-911b-4e1ec35daff1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:53 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:26:54 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ff606-ee24-40a2-b0af-87b4edc06e3d]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG os_brick.utils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating existing volume attachment record: e2a9dd90-cf1e-429b-adda-a594e93efffd {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:26:54 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:26:54 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=25.198680877685547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:26:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:26:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:26:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:27:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTyvfmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:27:04 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:27:04 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:27:04 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e64260-9acd-48d3-9105-2415d635db52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:27:04 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[209fb46b-ee11-4e05-b209-90ffd7d21ab4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f] added
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[106966ca-f137-4eff-af56-4846f0a19261]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8ab31-4554-460e-8ad5-ca4d98c63cac]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKTyvfmR {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKTyvfmR" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[954094e1-7ae9-492b-867e-4f4e12863899]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKTyvfmR'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f0d957-9550-4229-91fc-98ecf5675e95]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[17669f96-df3d-4fb8-9365-ea67063274a4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[754501f7-7cff-49fe-a94f-1564ae4eb46a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260]
Aug 27 01:27:04 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260] successful.
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf3095-12db-4df1-a800-748a7d6a04b1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b12ed4-7a89-4811-b2b4-292fe048d686]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:04 user nova-compute[73458]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:04 user nova-compute[73458]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)
Aug 27 01:27:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e30f13-5acf-47fc-b2ed-699105b37078]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:27:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTyvfmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:27:05 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:27:05 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26432643937373131', 'path': '/dev/sdc'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:27:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432643937373131', 'path': '/dev/sdc'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:27:05 user nova-compute[73458]: DEBUG nova.objects.instance [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:27:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:27:05 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:27:05 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:27:05 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:27:05 user nova-compute[73458]:   <serial>58f5a328-d465-496d-96a7-734942b3f87f</serial>
Aug 27 01:27:05 user nova-compute[73458]: </disk>
Aug 27 01:27:05 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:27:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:27:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:27:06 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] No VIF found with MAC fa:16:3e:1f:94:26, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:27:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-f5da38b1-7ede-47c8-b965-71e7563b2852 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.713s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:27:08 user nova-compute[73458]: INFO nova.compute.manager [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Detaching volume 58f5a328-d465-496d-96a7-734942b3f87f
Aug 27 01:27:08 user nova-compute[73458]: INFO nova.virt.block_device [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Attempting to driver detach volume 58f5a328-d465-496d-96a7-734942b3f87f from mountpoint /dev/vdb
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Attempting to detach device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:27:08 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:27:08 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:27:08 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:27:08 user nova-compute[73458]:   <serial>58f5a328-d465-496d-96a7-734942b3f87f</serial>
Aug 27 01:27:08 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:27:08 user nova-compute[73458]: </disk>
Aug 27 01:27:08 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:27:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the persistent domain config.
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:27:08 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:27:08 user nova-compute[73458]:   <source dev="/dev/sdc"/>
Aug 27 01:27:08 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:27:08 user nova-compute[73458]:   <serial>58f5a328-d465-496d-96a7-734942b3f87f</serial>
Aug 27 01:27:08 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:27:08 user nova-compute[73458]: </disk>
Aug 27 01:27:08 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099628.656306, 8289084b-7977-4511-a59e-2d9a2b46fd9d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:27:08 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully detached device vdb from instance 8289084b-7977-4511-a59e-2d9a2b46fd9d from the live domain config.
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKTyvfmR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:27:08 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[51455f91-f65f-47b0-b9c7-94bd79237d13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d763ff9-9da4-44ad-af07-27963384aa46]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:08 user nova-compute[73458]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)
Aug 27 01:27:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:27:08 user nova-compute[73458]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f (non-flash)
Aug 27 01:27:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e783a0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f'): ({'sdc'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Removing single pathed devices sdc {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0c238-fd3c-4789-9145-b84da007d46b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b9d50-37e7-4612-8db9-1d874326bbb9]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Flushing IO for device /dev/sdc {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0b0740-b973-459d-a8c0-3b58f48cae57]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e77e3-4956-4164-9d2b-93868a531980]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] SCSI volumes sdc have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab034ce0-a107-46e9-b991-8db81b6b118a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0767d5d-591c-4b21-b15a-75246ef5831e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260]
Aug 27 01:27:08 user nova-compute[73458]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f, portal: 172.16.0.220,3260] successful.
Aug 27 01:27:08 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f5a328-d465-496d-96a7-734942b3f87f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e610686f-7f7e-477e-ae1e-caead23b77d2]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] <== disconnect_volume: return (282ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:27:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'flavor' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:27:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae457569-2a46-4398-aea7-6705a73283a0 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.721s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:27:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:46 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:27:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:27:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:27:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:27:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:27:56 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.197677612304688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:27:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:27:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:27:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing instance network info cache due to event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updated VIF entry in instance network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG nova.network.neutron [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:28:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5bb27a39-79d4-4141-8ba9-a494af10a40d req-48bc9d9c-2aca-4847-8374-bce6e4382b7f service nova] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [{"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-8289084b-7977-4511-a59e-2d9a2b46fd9d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.compute.manager [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing instance network info cache due to event network-changed-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] Acquiring lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] Acquired lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Refreshing network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:03 user nova-compute[73458]: INFO nova.compute.manager [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Detaching volume f8c5fa54-9a59-4c9e-953c-31b78845c29d
Aug 27 01:28:03 user nova-compute[73458]: INFO nova.virt.block_device [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Attempting to driver detach volume f8c5fa54-9a59-4c9e-953c-31b78845c29d from mountpoint /dev/vdb
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Attempting to detach device vdb from instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:28:03 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:28:03 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:28:03 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:28:03 user nova-compute[73458]:   <serial>f8c5fa54-9a59-4c9e-953c-31b78845c29d</serial>
Aug 27 01:28:03 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:28:03 user nova-compute[73458]: </disk>
Aug 27 01:28:03 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:28:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully detached device vdb from instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db from the persistent domain config.
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:28:03 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:28:03 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:28:03 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:28:03 user nova-compute[73458]:   <serial>f8c5fa54-9a59-4c9e-953c-31b78845c29d</serial>
Aug 27 01:28:03 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 01:28:03 user nova-compute[73458]: </disk>
Aug 27 01:28:03 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693099683.7974083, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:28:03 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully detached device vdb from instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db from the live domain config.
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rPaLjsXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:28:03 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c943ceb-dc69-4663-bd63-7623fcc4b8b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff8f0b-5f41-4ea1-a8d6-3463c0ace185]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:28:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d (non-flash)
Aug 27 01:28:03 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78379c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5aa1ef-6b46-4705-ab3d-1b6c7644b06c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681e9ae-134d-4bbb-b93d-d64cc046d1f0]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee37bc0-f89e-4f4a-bcd0-8d33afb72343]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf3c504-a5af-422a-9e1c-7bff0a24c598]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updated VIF entry in instance network info cache for port f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG nova.network.neutron [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [{"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f5e59-d1c1-42c5-8217-b28937bba621]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-7fd61b82-5519-47c3-94b5-faa597e10f14 req-359cbbd4-d128-4ab5-94fb-51b17be3edb9 service nova] Releasing lock "refresh_cache-dc49a63b-676f-46ce-9d2e-9687b7c0a1db" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeab234d-96ee-4cb8-ba18-bc5f9e4f25c8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260]
Aug 27 01:28:04 user nova-compute[73458]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d, portal: 172.16.0.220,3260] successful.
Aug 27 01:28:04 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8c5fa54-9a59-4c9e-953c-31b78845c29d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[71096755-b0e6-4e42-b3da-c2e20a564110]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== disconnect_volume: return (257ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG nova.objects.instance [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:28:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-990a2f81-e1fa-4dc3-9ff1-fb0572f440cf tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.730s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:28:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:28:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:46 user nova-compute[73458]: INFO nova.compute.manager [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Terminating instance
Aug 27 01:28:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-unplugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] No waiting events found dispatching network-vif-unplugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-0b95f05f-dc24-4415-bc0b-0aca93a62720 req-a2e13537-a08b-42e9-a7e4-1fee1291f8ef service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-unplugged-a62c6714-91cd-442b-a127-4529b553db2a for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Instance destroyed successfully.
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lazy-loading 'resources' on Instance uuid 8289084b-7977-4511-a59e-2d9a2b46fd9d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:20:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-152561704',display_name='tempest-SnapshotDataIntegrityTests-server-152561704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-152561704',id=49,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJllXs3Tazy8UlVF3Q1v+vqV6OUQ1sW7dkNrLbGGBOj1d//car8+U7SDoli9aKzYF+5Au4PiWxAbEFZR+RN8vqgb+uOwD0l0as3M+rUoza2TuHJO6qydPuhVQc5WTieMA==',key_name='tempest-keypair-914303875',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='087c2bacaf3c434580685e208b7f8529',ramdisk_id='',reservation_id='r-js07o95e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1339359446',owner_user_name='tempest-SnapshotDataIntegrityTests-1339359446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='579b8975446647ad8d4d9bae2aaf819a',uuid=8289084b-7977-4511-a59e-2d9a2b46fd9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converting VIF {"id": "a62c6714-91cd-442b-a127-4529b553db2a", "address": "fa:16:3e:1f:94:26", "network": {"id": "86736232-2b92-4c38-a253-64fc0ac4c656", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1621152622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "087c2bacaf3c434580685e208b7f8529", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa62c6714-91", "ovs_interfaceid": "a62c6714-91cd-442b-a127-4529b553db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG os_vif [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa62c6714-91, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:47 user nova-compute[73458]: INFO os_vif [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:94:26,bridge_name='br-int',has_traffic_filtering=True,id=a62c6714-91cd-442b-a127-4529b553db2a,network=Network(86736232-2b92-4c38-a253-64fc0ac4c656),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa62c6714-91')
Aug 27 01:28:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Deleting instance files /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d_del
Aug 27 01:28:47 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Deletion of /opt/stack/data/nova/instances/8289084b-7977-4511-a59e-2d9a2b46fd9d_del complete
Aug 27 01:28:47 user nova-compute[73458]: INFO nova.compute.manager [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 01:28:47 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:28:47 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:28:48 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Took 0.81 seconds to deallocate network for instance.
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-61f46157-7431-4aa0-94ae-532f809ac59e req-fca5f630-b72e-41ba-9f3e-638f7b31a0d4 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-deleted-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:28:48 user nova-compute[73458]: INFO nova.compute.manager [req-61f46157-7431-4aa0-94ae-532f809ac59e req-fca5f630-b72e-41ba-9f3e-638f7b31a0d4 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Neutron deleted interface a62c6714-91cd-442b-a127-4529b553db2a; detaching it from the instance and deleting it from the info cache
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.network.neutron [req-61f46157-7431-4aa0-94ae-532f809ac59e req-fca5f630-b72e-41ba-9f3e-638f7b31a0d4 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.compute.manager [req-61f46157-7431-4aa0-94ae-532f809ac59e req-fca5f630-b72e-41ba-9f3e-638f7b31a0d4 service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Detach interface failed, port_id=a62c6714-91cd-442b-a127-4529b553db2a, reason: Instance 8289084b-7977-4511-a59e-2d9a2b46fd9d could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:28:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:48 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Deleted allocations for instance 8289084b-7977-4511-a59e-2d9a2b46fd9d
Aug 27 01:28:48 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0a6dfc30-e103-49c7-a18b-d534da552d91 tempest-SnapshotDataIntegrityTests-1339359446 tempest-SnapshotDataIntegrityTests-1339359446-project-member] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:28:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] Acquiring lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] Lock "8289084b-7977-4511-a59e-2d9a2b46fd9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:49 user nova-compute[73458]: DEBUG nova.compute.manager [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] No waiting events found dispatching network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:28:49 user nova-compute[73458]: WARNING nova.compute.manager [req-a2dd0f8e-371a-41c7-ae85-ca237066b3cc req-acce9d64-5a81-4341-bb52-a34095b0a85a service nova] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Received unexpected event network-vif-plugged-a62c6714-91cd-442b-a127-4529b553db2a for instance with vm_state deleted and task_state None.
Aug 27 01:28:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:28:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:54 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:28:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:28:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:28:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=25.216571807861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:28:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:28:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:28:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:00 user nova-compute[73458]: INFO nova.compute.manager [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Terminating instance
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-8be7f257-5255-41b0-8f62-38f7581801ce req-cf44e312-7602-41c4-a7a6-c66d42072793 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-unplugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:29:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Instance destroyed successfully.
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.objects.instance [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'resources' on Instance uuid dc49a63b-676f-46ce-9d2e-9687b7c0a1db {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-975264753',display_name='tempest-TestMinimumBasicScenario-server-975264753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-975264753',id=51,image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiJ5D2fT59V1wqukEMNAC2iYUn4zO6jbGpC2mBRI3IMNNUD91W1UI0GG2dn2n5/46RlP2lbnjxdAOmuKP9HMeT0MRlagA2IITt02dYmubTGO8LnF9KdX4T7EaL1+tXPWw==',key_name='tempest-TestMinimumBasicScenario-2099005190',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-czdnhce9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='923725ab-3a65-4485-8c1e-3dd27268f504',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:26:17Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=dc49a63b-676f-46ce-9d2e-9687b7c0a1db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "address": "fa:16:3e:de:23:99", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04d1ccd-4e", "ovs_interfaceid": "f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG os_vif [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04d1ccd-4e, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:00 user nova-compute[73458]: INFO os_vif [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:23:99,bridge_name='br-int',has_traffic_filtering=True,id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04d1ccd-4e')
Aug 27 01:29:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Deleting instance files /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db_del
Aug 27 01:29:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Deletion of /opt/stack/data/nova/instances/dc49a63b-676f-46ce-9d2e-9687b7c0a1db_del complete
Aug 27 01:29:01 user nova-compute[73458]: INFO nova.compute.manager [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:29:01 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Took 0.51 seconds to deallocate network for instance.
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fb42153-8e61-4f81-a10f-2f0a128fc9ca req-249b6153-a59e-4a78-b5a5-0599c603193c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-deleted-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:29:01 user nova-compute[73458]: INFO nova.compute.manager [req-2fb42153-8e61-4f81-a10f-2f0a128fc9ca req-249b6153-a59e-4a78-b5a5-0599c603193c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Neutron deleted interface f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74; detaching it from the instance and deleting it from the info cache
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-2fb42153-8e61-4f81-a10f-2f0a128fc9ca req-249b6153-a59e-4a78-b5a5-0599c603193c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.compute.manager [req-2fb42153-8e61-4f81-a10f-2f0a128fc9ca req-249b6153-a59e-4a78-b5a5-0599c603193c service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Detach interface failed, port_id=f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74, reason: Instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db could not be found. {{(pid=73458) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:01 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Deleted allocations for instance dc49a63b-676f-46ce-9d2e-9687b7c0a1db
Aug 27 01:29:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-0e0249e5-0ba2-4544-8ce2-ad2d37d74dfe tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.689s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099727.5461934, 8289084b-7977-4511-a59e-2d9a2b46fd9d => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:29:02 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] VM Stopped (Lifecycle Event)
Aug 27 01:29:02 user nova-compute[73458]: DEBUG nova.compute.manager [None req-0ca42dcb-ebac-41a0-96d0-a63912a6d664 None None] [instance: 8289084b-7977-4511-a59e-2d9a2b46fd9d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] Acquiring lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] Lock "dc49a63b-676f-46ce-9d2e-9687b7c0a1db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:02 user nova-compute[73458]: DEBUG nova.compute.manager [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] No waiting events found dispatching network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:29:02 user nova-compute[73458]: WARNING nova.compute.manager [req-10908db1-1527-4218-b546-41898c3f67cc req-c93ff985-4a4b-4a64-a549-31fd2e810770 service nova] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Received unexpected event network-vif-plugged-f04d1ccd-4e86-4bd8-a4a3-1f408e7e9a74 for instance with vm_state deleted and task_state None.
Aug 27 01:29:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:29:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:29:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:15 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693099740.956435, dc49a63b-676f-46ce-9d2e-9687b7c0a1db => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:29:15 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] VM Stopped (Lifecycle Event)
Aug 27 01:29:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-51c37835-6d2b-4ae3-b765-4d83bd89ce81 None None] [instance: dc49a63b-676f-46ce-9d2e-9687b7c0a1db] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:29:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:41 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:46 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:51 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:29:54 user nova-compute[73458]: INFO nova.compute.claims [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Claim successful on node user
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:29:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:29:54 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Creating image(s)
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "/opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "/opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "475f4577b3da3c6604360afe3f366251fa0524ef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "475f4577b3da3c6604360afe3f366251fa0524ef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:54 user nova-compute[73458]: DEBUG nova.policy [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd19531889c27435fb65b15e0586efb9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7182f87bfe9b4238b46dcc951bb1be4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.part --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG nova.virt.images [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] 4fc5009a-b256-4df0-ad21-15b2eca46dad was qcow2, converting to raw {{(pid=73458) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG nova.privsep.utils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73458) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.part /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.converted {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Successfully created port: c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.part /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.converted" returned: 0 in 0.263s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:55 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.converted --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "475f4577b3da3c6604360afe3f366251fa0524ef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.162s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json" returned: 0 in 0.169s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "475f4577b3da3c6604360afe3f366251fa0524ef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "475f4577b3da3c6604360afe3f366251fa0524ef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef,backing_fmt=raw /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef,backing_fmt=raw /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk 1073741824" returned: 0 in 0.049s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "475f4577b3da3c6604360afe3f366251fa0524ef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Successfully updated port: c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475f4577b3da3c6604360afe3f366251fa0524ef --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.compute.manager [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing instance network info cache due to event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Cannot resize image /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Ensure instance console log exists: /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:56 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.neutron [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance network_info: |[{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Start _get_guest_xml network_info=[{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T01:29:51Z,direct_url=<?>,disk_format='qcow2',id=4fc5009a-b256-4df0-ad21-15b2eca46dad,min_disk=0,min_ram=0,name='tempest-scenario-img--1907875575',owner='7182f87bfe9b4238b46dcc951bb1be4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T01:29:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '4fc5009a-b256-4df0-ad21-15b2eca46dad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:29:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:29:57 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T01:29:51Z,direct_url=<?>,disk_format='qcow2',id=4fc5009a-b256-4df0-ad21-15b2eca46dad,min_disk=0,min_ram=0,name='tempest-scenario-img--1907875575',owner='7182f87bfe9b4238b46dcc951bb1be4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T01:29:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-792785574',display_name='tempest-TestMinimumBasicScenario-server-792785574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-792785574',id=52,image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItTEMa+6An4CJvvZ2wUvwv/wLs+aAdkRXyuqO9Z4I7uc8jb9TQL4VwXsEyzjJIVwONMW6v7PgRi89J5v9L/cFNRiAF1Wh0oYVtv2nwIdFEVRAFZc2lG3X9ZHPeDMqiYQw==',key_name='tempest-TestMinimumBasicScenario-547064109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-ncd9oewi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:29:55Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.objects.instance [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'pci_devices' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:29:57 user nova-compute[73458]:   <uuid>fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d</uuid>
Aug 27 01:29:57 user nova-compute[73458]:   <name>instance-00000034</name>
Aug 27 01:29:57 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:29:57 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:29:57 user nova-compute[73458]:   <metadata>
Aug 27 01:29:57 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:29:57 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:name>tempest-TestMinimumBasicScenario-server-792785574</nova:name>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:29:57</nova:creationTime>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:29:57 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:29:57 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:owner>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:user uuid="d19531889c27435fb65b15e0586efb9e">tempest-TestMinimumBasicScenario-1394839998-project-member</nova:user>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:project uuid="7182f87bfe9b4238b46dcc951bb1be4c">tempest-TestMinimumBasicScenario-1394839998</nova:project>
Aug 27 01:29:57 user nova-compute[73458]:       </nova:owner>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:root type="image" uuid="4fc5009a-b256-4df0-ad21-15b2eca46dad"/>
Aug 27 01:29:57 user nova-compute[73458]:       <nova:ports>
Aug 27 01:29:57 user nova-compute[73458]:         <nova:port uuid="c3a9fdf8-b422-47e5-b3b9-e7b941d645d5">
Aug 27 01:29:57 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 01:29:57 user nova-compute[73458]:         </nova:port>
Aug 27 01:29:57 user nova-compute[73458]:       </nova:ports>
Aug 27 01:29:57 user nova-compute[73458]:     </nova:instance>
Aug 27 01:29:57 user nova-compute[73458]:   </metadata>
Aug 27 01:29:57 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:29:57 user nova-compute[73458]:     <system>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="serial">fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d</entry>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="uuid">fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d</entry>
Aug 27 01:29:57 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:29:57 user nova-compute[73458]:     </system>
Aug 27 01:29:57 user nova-compute[73458]:   </sysinfo>
Aug 27 01:29:57 user nova-compute[73458]:   <os>
Aug 27 01:29:57 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:29:57 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:29:57 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:29:57 user nova-compute[73458]:   </os>
Aug 27 01:29:57 user nova-compute[73458]:   <features>
Aug 27 01:29:57 user nova-compute[73458]:     <acpi/>
Aug 27 01:29:57 user nova-compute[73458]:     <apic/>
Aug 27 01:29:57 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:29:57 user nova-compute[73458]:   </features>
Aug 27 01:29:57 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:29:57 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:29:57 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:29:57 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:29:57 user nova-compute[73458]:   </clock>
Aug 27 01:29:57 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:29:57 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:29:57 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:29:57 user nova-compute[73458]:   </cpu>
Aug 27 01:29:57 user nova-compute[73458]:   <devices>
Aug 27 01:29:57 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:29:57 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:29:57 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk"/>
Aug 27 01:29:57 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:29:57 user nova-compute[73458]:     </disk>
Aug 27 01:29:57 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:29:57 user nova-compute[73458]:       <mac address="fa:16:3e:98:0b:12"/>
Aug 27 01:29:57 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:29:57 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:29:57 user nova-compute[73458]:       <target dev="tapc3a9fdf8-b4"/>
Aug 27 01:29:57 user nova-compute[73458]:     </interface>
Aug 27 01:29:57 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:29:57 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/console.log" append="off"/>
Aug 27 01:29:57 user nova-compute[73458]:     </serial>
Aug 27 01:29:57 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:29:57 user nova-compute[73458]:     <video>
Aug 27 01:29:57 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:29:57 user nova-compute[73458]:     </video>
Aug 27 01:29:57 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:29:57 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:29:57 user nova-compute[73458]:     </rng>
Aug 27 01:29:57 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:29:57 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:29:57 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:29:57 user nova-compute[73458]:     </memballoon>
Aug 27 01:29:57 user nova-compute[73458]:   </devices>
Aug 27 01:29:57 user nova-compute[73458]: </domain>
Aug 27 01:29:57 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-792785574',display_name='tempest-TestMinimumBasicScenario-server-792785574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-792785574',id=52,image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItTEMa+6An4CJvvZ2wUvwv/wLs+aAdkRXyuqO9Z4I7uc8jb9TQL4VwXsEyzjJIVwONMW6v7PgRi89J5v9L/cFNRiAF1Wh0oYVtv2nwIdFEVRAFZc2lG3X9ZHPeDMqiYQw==',key_name='tempest-TestMinimumBasicScenario-547064109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-ncd9oewi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:29:55Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG os_vif [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3a9fdf8-b4, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3a9fdf8-b4, col_values=(('external_ids', {'iface-id': 'c3a9fdf8-b422-47e5-b3b9-e7b941d645d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:0b:12', 'vm-uuid': 'fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:57 user nova-compute[73458]: INFO os_vif [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4')
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No VIF found with MAC fa:16:3e:98:0b:12, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated VIF entry in instance network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG nova.network.neutron [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:29:57 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a976bf9b-1e22-42f0-be57-19dcafc8afa3 req-a89fa97f-05d0-48a1-ba38-0f1a881acf2a service nova] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:29:58 user nova-compute[73458]: DEBUG nova.compute.manager [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:29:58 user nova-compute[73458]: WARNING nova.compute.manager [req-61630a0e-be06-40a4-a812-21104881bdaf req-97805909-3e30-4383-bce0-dca30e50a7eb service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state building and task_state spawning.
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:29:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:29:59 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=25.22152328491211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:29:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099800.6564915, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] VM Resumed (Lifecycle Event)
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance spawned successfully.
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099800.6584024, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] VM Started (Lifecycle Event)
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:30:00 user nova-compute[73458]: INFO nova.compute.manager [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Took 6.40 seconds to build instance.
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:30:00 user nova-compute[73458]: WARNING nova.compute.manager [req-4834da9a-c28d-4046-8b5d-058d488598d9 req-3efe6cf3-39fa-434f-ab92-5e892b3fc05e service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state building and task_state spawning.
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-e8971ea2-3a2e-4cfb-92d9-c6e87fde1226 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.495s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:30:05 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:30:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:30:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:30:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:30:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:31 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:30:31 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:30:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:30:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:30:57 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:31:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:31:01 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.192562103271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:31:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:31:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:31:06 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:31:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:48 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG nova.objects.instance [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:31:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:31:49 user nova-compute[73458]: INFO nova.compute.manager [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Attaching volume 985537b1-042e-49d0-b0c9-0027eb6ad8d2 to /dev/vdb
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.utils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[93590f5a-d468-4d8e-baa8-685600bbc9d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b17a2a-f8a4-4b14-b237-5bb40140d609]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a11f7a4-be09-4d5a-ac16-008761cdf8f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f303bd-ebf5-4426-b756-2f6d26641cc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:31:50 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:31:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f210d634-9b93-427d-9576-50591fe930cf]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG os_brick.utils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:31:50 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating existing volume attachment record: 0317e882-d238-4cbe-a2bc-37bddbf0c451 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:31:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:31:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:31:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:58 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:58 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:31:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVRiHsNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:32:00 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:32:00 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:32:00 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d808d9-145b-4bcd-a06d-a14a45f9b2a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:32:00 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3695632-896d-4c41-b23e-bdf807c3bf5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2] added
Aug 27 01:32:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c4ca4-c6f6-43fd-8e1e-68846052f6f8]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d71f2bd-a350-4480-ba01-77614a42ea3d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVRiHsNw {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVRiHsNw" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c5710-cb98-4a55-85d7-93da76abd1a9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVRiHsNw'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b8cd6-6ab3-40cd-80a9-8eed8814e461]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7208fdd9-b79d-4b3a-8b8c-d1ae8f7377fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:32:00 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:32:00 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:32:00 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:32:00 user nova-compute[73458]: 
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f6c35d-e9ab-4270-9fdf-e0300d872ad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260]
Aug 27 01:32:00 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260] successful.
Aug 27 01:32:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[34989b76-cff5-4bf4-9835-ff87c5dfb207]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a5b71-0349-414e-87d3-ccea71551a4e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)
Aug 27 01:32:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)
Aug 27 01:32:00 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8aa18-0514-4297-b306-af3c82affdd6]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:32:00 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVRiHsNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23866393730356634', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866393730356634', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG nova.objects.instance [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:32:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:32:01 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:32:01 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:32:01 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:32:01 user nova-compute[73458]:   <serial>985537b1-042e-49d0-b0c9-0027eb6ad8d2</serial>
Aug 27 01:32:01 user nova-compute[73458]: </disk>
Aug 27 01:32:01 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] No VIF found with MAC fa:16:3e:98:0b:12, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-74329407-8319-4acb-b042-91799563e2b5 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.599s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:32:02 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:32:03 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:32:03 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.191699981689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:32:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing instance network info cache due to event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:32:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:32:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:32:05 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:32:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated VIF entry in instance network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:32:06 user nova-compute[73458]: DEBUG nova.network.neutron [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:32:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-f0d56064-0d70-4225-bb96-69192adf6173 req-86a3a422-ce26-4dd2-9958-826e993c8f46 service nova] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing instance network info cache due to event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:07 user nova-compute[73458]: INFO nova.compute.manager [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Rebooting instance
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:32:07 user nova-compute[73458]: DEBUG nova.network.neutron [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:32:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated VIF entry in instance network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:32:08 user nova-compute[73458]: DEBUG nova.network.neutron [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:32:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0706b01e-c7a6-4822-9cd7-d00c651dbbaf req-0cd17612-e335-4a1c-87de-e9780211c4a3 service nova] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:32:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:32:08 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:32:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:32:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:32:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:32:09 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:11 user nova-compute[73458]: DEBUG nova.compute.manager [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:32:11 user nova-compute[73458]: WARNING nova.compute.manager [req-446fbe5f-2b7c-40bc-a75a-0ceff88b6f9a req-b84e14cb-d349-463b-984e-510572f587fe service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state active and task_state reboot_started.
Aug 27 01:32:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:12 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance shutdown successfully.
Aug 27 01:32:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:13 user nova-compute[73458]: DEBUG nova.compute.manager [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:32:13 user nova-compute[73458]: WARNING nova.compute.manager [req-873dcb01-1c15-4bbf-a5e7-db005a2b486a req-42c2be16-f25e-4423-9468-b4f601b55759 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state active and task_state reboot_started.
Aug 27 01:32:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Removed pending event for fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d due to event {{(pid=73458) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099935.7414165, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:32:15 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] VM Resumed (Lifecycle Event)
Aug 27 01:32:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance running successfully.
Aug 27 01:32:15 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance soft rebooted successfully.
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:32:15 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693099935.744557, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:32:15 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] VM Started (Lifecycle Event)
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:32:15 user nova-compute[73458]: WARNING nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state active and task_state reboot_started.
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:32:15 user nova-compute[73458]: WARNING nova.compute.manager [req-66e5b3aa-953f-4c8a-8afb-a0eb77265102 req-f503c999-be1a-45b9-b75f-b41b65db553d service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state active and task_state reboot_started.
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:32:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-d81a8492-905b-4ff1-95c4-09d0ee8db247 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.945s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:32:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:49 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:32:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:32:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:32:58 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:32:58 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:32:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:33:03 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:33:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:33:04 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=25.189918518066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:33:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:33:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:33:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:33:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:51 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:33:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG nova.compute.manager [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing instance network info cache due to event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG nova.network.neutron [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:33:59 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated VIF entry in instance network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-8c341b77-1e5c-4f46-a1bd-6a6f465ee00f req-5bdd9c4f-86c0-45f0-bbff-ff5876e8fed2 service nova] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.compute.manager [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing instance network info cache due to event network-changed-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.network.neutron [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Refreshing network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:34:00 user nova-compute[73458]: INFO nova.compute.manager [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Detaching volume 985537b1-042e-49d0-b0c9-0027eb6ad8d2
Aug 27 01:34:00 user nova-compute[73458]: INFO nova.virt.block_device [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Attempting to driver detach volume 985537b1-042e-49d0-b0c9-0027eb6ad8d2 from mountpoint /dev/vdb
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Attempting to detach device vdb from instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:34:00 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:34:00 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:34:00 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:34:00 user nova-compute[73458]:   <serial>985537b1-042e-49d0-b0c9-0027eb6ad8d2</serial>
Aug 27 01:34:00 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:34:00 user nova-compute[73458]: </disk>
Aug 27 01:34:00 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:34:00 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully detached device vdb from instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d from the persistent domain config.
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:34:00 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:34:00 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:34:00 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:34:00 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:34:00 user nova-compute[73458]:   <serial>985537b1-042e-49d0-b0c9-0027eb6ad8d2</serial>
Aug 27 01:34:00 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:34:00 user nova-compute[73458]: </disk>
Aug 27 01:34:00 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated VIF entry in instance network info cache for port c3a9fdf8-b422-47e5-b3b9-e7b941d645d5. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.network.neutron [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ed613018-fcc6-48ed-bc99-505e0dbb6978 req-f87bd03b-fd66-4685-bf8a-26b208f82095 service nova] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693100041.2433517, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:34:01 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully detached device vdb from instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d from the live domain config.
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVRiHsNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:34:01 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4f874-b173-44ad-afce-cf6b0943c731]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cd819b-746f-4c37-8600-092a90a0f024]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)
Aug 27 01:34:01 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 (non-flash)
Aug 27 01:34:01 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7859b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[de49f29c-bd07-4380-94ae-16ff305ae9f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b31af-4e89-4d87-b055-c1c56e0009f6]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9eacb7-ab25-4733-bb23-129cfa31999d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9679e0-d474-4faa-ad8c-1e4ef3fdd2e8]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d7a8bd-3b67-4990-a6f4-63e82364e775]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594056e-588e-4577-99e5-2d27c92e19fe]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260]
Aug 27 01:34:01 user nova-compute[73458]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2, portal: 172.16.0.220,3260] successful.
Aug 27 01:34:01 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985537b1-042e-49d0-b0c9-0027eb6ad8d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9e2668-125a-41c1-905c-f750173ee843]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] <== disconnect_volume: return (264ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:34:01 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:34:02 user nova-compute[73458]: DEBUG nova.objects.instance [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'flavor' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:34:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:02 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-704aedd1-dfcc-4ed9-b5d6-ee4d0d02a1f3 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:34:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:34:05 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:34:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:34:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.18914031982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:34:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:34:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [{"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:34:10 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:34:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:34:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:53 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:34:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:34:59 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:35:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:35:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:04 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:05 user nova-compute[73458]: INFO nova.compute.manager [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Terminating instance
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.compute.manager [req-6a650df1-012c-464a-a2f9-0d7badf6137c req-caf078b0-baf1-4742-a5e8-84d86e617146 service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-unplugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Instance destroyed successfully.
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.objects.instance [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lazy-loading 'resources' on Instance uuid fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-792785574',display_name='tempest-TestMinimumBasicScenario-server-792785574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-792785574',id=52,image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItTEMa+6An4CJvvZ2wUvwv/wLs+aAdkRXyuqO9Z4I7uc8jb9TQL4VwXsEyzjJIVwONMW6v7PgRi89J5v9L/cFNRiAF1Wh0oYVtv2nwIdFEVRAFZc2lG3X9ZHPeDMqiYQw==',key_name='tempest-TestMinimumBasicScenario-547064109',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:30:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7182f87bfe9b4238b46dcc951bb1be4c',ramdisk_id='',reservation_id='r-ncd9oewi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fc5009a-b256-4df0-ad21-15b2eca46dad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1394839998',owner_user_name='tempest-TestMinimumBasicScenario-1394839998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:32:16Z,user_data=None,user_id='d19531889c27435fb65b15e0586efb9e',uuid=fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converting VIF {"id": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "address": "fa:16:3e:98:0b:12", "network": {"id": "87ddf579-9334-4d39-ba88-156a730c4f33", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1817917695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7182f87bfe9b4238b46dcc951bb1be4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3a9fdf8-b4", "ovs_interfaceid": "c3a9fdf8-b422-47e5-b3b9-e7b941d645d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG os_vif [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3a9fdf8-b4, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:05 user nova-compute[73458]: INFO os_vif [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:0b:12,bridge_name='br-int',has_traffic_filtering=True,id=c3a9fdf8-b422-47e5-b3b9-e7b941d645d5,network=Network(87ddf579-9334-4d39-ba88-156a730c4f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3a9fdf8-b4')
Aug 27 01:35:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Deleting instance files /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d_del
Aug 27 01:35:05 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Deletion of /opt/stack/data/nova/instances/fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d_del complete
Aug 27 01:35:05 user nova-compute[73458]: INFO nova.compute.manager [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 01:35:05 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:35:05 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:35:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:35:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.21648406982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:35:06 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Took 0.85 seconds to deallocate network for instance.
Aug 27 01:35:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:35:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.223s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:07 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Deleted allocations for instance fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-7bc0d205-5563-4d2e-9d51-9f44f9140728 tempest-TestMinimumBasicScenario-1394839998 tempest-TestMinimumBasicScenario-1394839998-project-member] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] Acquiring lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] Lock "fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] No waiting events found dispatching network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:35:07 user nova-compute[73458]: WARNING nova.compute.manager [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received unexpected event network-vif-plugged-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 for instance with vm_state deleted and task_state None.
Aug 27 01:35:07 user nova-compute[73458]: DEBUG nova.compute.manager [req-eb3db904-cca2-4abe-ba93-f3a31f9069ac req-2d69f214-9d86-42a2-a1a7-013f75017b6b service nova] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Received event network-vif-deleted-c3a9fdf8-b422-47e5-b3b9-e7b941d645d5 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:35:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:35:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:35:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:35:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:35:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:20 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693100105.7851336, fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:35:20 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] VM Stopped (Lifecycle Event)
Aug 27 01:35:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-c621df9e-61eb-4f18-8490-54f616076bf1 None None] [instance: fa38eac7-4b62-43aa-a2cd-ba3ca5fb0e8d] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:35:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:36 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:35:36 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:35:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:41 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:35:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:35:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:35:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:00 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:00 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:36:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:36:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:36:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.255165100097656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:36:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:36:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:36:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:36:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:36:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:36:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:36:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:36:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:36:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:36:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:37:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:37:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:37:06 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8912MB free_disk=25.25408172607422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:37:06 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:37:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:08 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:13 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:37:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:37:13 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:37:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:37:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:37:57 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:00 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:38:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:05 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:38:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:38:08 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=25.254268646240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:38:08 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:38:15 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:20 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:24 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Starting instance... {{(pid=73458) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73458) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 01:38:39 user nova-compute[73458]: INFO nova.compute.claims [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Claim successful on node user
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Start building networks asynchronously for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Allocating IP information in the background. {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] allocate_for_instance() {{(pid=73458) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 01:38:39 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Start building block device mappings for instance. {{(pid=73458) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.policy [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e814e71cf1d345078ec1966ba760a82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1043430ec22402a9ce4354814257b0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73458) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Start spawning the instance on the hypervisor. {{(pid=73458) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Creating instance directory {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 01:38:39 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Creating image(s)
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "/opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "/opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:39 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.201s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk 1073741824 {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0,backing_fmt=raw /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk 1073741824" returned: 0 in 0.070s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "2c6c227bf55330e3d87e9319851c24e42e1c87b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c6c227bf55330e3d87e9319851c24e42e1c87b0 --force-share --output=json" returned: 0 in 0.254s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk. size=1073741824 {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG nova.virt.disk.api [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Cannot resize image /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk to a smaller size. {{(pid=73458) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Created local disks {{(pid=73458) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Ensure instance console log exists: /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/console.log {{(pid=73458) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Successfully created port: 56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Successfully updated port: 56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Building network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-changed-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.compute.manager [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Refreshing instance network info cache due to event network-changed-56400d7d-96d9-4482-bb9c-1f66784b5339. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:38:41 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Instance cache missing network info. {{(pid=73458) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.neutron [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Instance network_info: |[{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73458) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Refreshing network info cache for port 56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Start _get_guest_xml network_info=[{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_options': None, 'image_id': '8d38b8b6-6075-47a6-bfce-08caf5b910c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 01:38:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:38:42 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CPU controller missing on host. {{(pid=73458) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.host [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CPU controller found on host. {{(pid=73458) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73458) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T00:44:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T00:44:43Z,direct_url=<?>,disk_format='qcow2',id=8d38b8b6-6075-47a6-bfce-08caf5b910c3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='30ea5393da3343a0a6ea0b4cecd9cd8b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T00:44:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flavor limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Image limits 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flavor pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Image pref 0:0:0 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Got 1 possible topologies {{(pid=73458) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.hardware [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73458) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913530719',display_name='tempest-SnapshotDataIntegrityTests-server-1913530719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913530719',id=53,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy5ywwrwELbkPyiMWjKFK+jOur2krd58e7+MMPWDYYGVr5hGIHyAjpGMX/pqfS49jo/y6f4UsW2f7/lTpZL78n+atVGNmoDsOG7y3hbpx2V2c9MWtE6OuHtvKl0Aysx/Q==',key_name='tempest-keypair-1526123984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1043430ec22402a9ce4354814257b0c',ramdisk_id='',reservation_id='r-apqz4w1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-298794449',owner_user_name='tempest-SnapshotDataIntegrityTests-298794449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e814e71cf1d345078ec1966ba760a82b',uuid=9bf031e0-859e-4f6c-be7f-1aabb4024028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73458) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converting VIF {"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.objects.instance [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] End _get_guest_xml xml=<domain type="kvm">
Aug 27 01:38:42 user nova-compute[73458]:   <uuid>9bf031e0-859e-4f6c-be7f-1aabb4024028</uuid>
Aug 27 01:38:42 user nova-compute[73458]:   <name>instance-00000035</name>
Aug 27 01:38:42 user nova-compute[73458]:   <memory>524288</memory>
Aug 27 01:38:42 user nova-compute[73458]:   <vcpu>1</vcpu>
Aug 27 01:38:42 user nova-compute[73458]:   <metadata>
Aug 27 01:38:42 user nova-compute[73458]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 01:38:42 user nova-compute[73458]:       <nova:package version="0.0.0"/>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1913530719</nova:name>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:creationTime>2023-08-27 01:38:42</nova:creationTime>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:flavor name="m1.tiny">
Aug 27 01:38:42 user nova-compute[73458]:         <nova:memory>512</nova:memory>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:disk>1</nova:disk>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:swap>0</nova:swap>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:vcpus>1</nova:vcpus>
Aug 27 01:38:42 user nova-compute[73458]:       </nova:flavor>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:owner>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:user uuid="e814e71cf1d345078ec1966ba760a82b">tempest-SnapshotDataIntegrityTests-298794449-project-member</nova:user>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:project uuid="e1043430ec22402a9ce4354814257b0c">tempest-SnapshotDataIntegrityTests-298794449</nova:project>
Aug 27 01:38:42 user nova-compute[73458]:       </nova:owner>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:root type="image" uuid="8d38b8b6-6075-47a6-bfce-08caf5b910c3"/>
Aug 27 01:38:42 user nova-compute[73458]:       <nova:ports>
Aug 27 01:38:42 user nova-compute[73458]:         <nova:port uuid="56400d7d-96d9-4482-bb9c-1f66784b5339">
Aug 27 01:38:42 user nova-compute[73458]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 01:38:42 user nova-compute[73458]:         </nova:port>
Aug 27 01:38:42 user nova-compute[73458]:       </nova:ports>
Aug 27 01:38:42 user nova-compute[73458]:     </nova:instance>
Aug 27 01:38:42 user nova-compute[73458]:   </metadata>
Aug 27 01:38:42 user nova-compute[73458]:   <sysinfo type="smbios">
Aug 27 01:38:42 user nova-compute[73458]:     <system>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="product">OpenStack Nova</entry>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="version">0.0.0</entry>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="serial">9bf031e0-859e-4f6c-be7f-1aabb4024028</entry>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="uuid">9bf031e0-859e-4f6c-be7f-1aabb4024028</entry>
Aug 27 01:38:42 user nova-compute[73458]:       <entry name="family">Virtual Machine</entry>
Aug 27 01:38:42 user nova-compute[73458]:     </system>
Aug 27 01:38:42 user nova-compute[73458]:   </sysinfo>
Aug 27 01:38:42 user nova-compute[73458]:   <os>
Aug 27 01:38:42 user nova-compute[73458]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 01:38:42 user nova-compute[73458]:     <boot dev="hd"/>
Aug 27 01:38:42 user nova-compute[73458]:     <smbios mode="sysinfo"/>
Aug 27 01:38:42 user nova-compute[73458]:   </os>
Aug 27 01:38:42 user nova-compute[73458]:   <features>
Aug 27 01:38:42 user nova-compute[73458]:     <acpi/>
Aug 27 01:38:42 user nova-compute[73458]:     <apic/>
Aug 27 01:38:42 user nova-compute[73458]:     <vmcoreinfo/>
Aug 27 01:38:42 user nova-compute[73458]:   </features>
Aug 27 01:38:42 user nova-compute[73458]:   <clock offset="utc">
Aug 27 01:38:42 user nova-compute[73458]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 01:38:42 user nova-compute[73458]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 01:38:42 user nova-compute[73458]:     <timer name="hpet" present="no"/>
Aug 27 01:38:42 user nova-compute[73458]:   </clock>
Aug 27 01:38:42 user nova-compute[73458]:   <cpu mode="custom" match="exact">
Aug 27 01:38:42 user nova-compute[73458]:     <model>Nehalem</model>
Aug 27 01:38:42 user nova-compute[73458]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 01:38:42 user nova-compute[73458]:   </cpu>
Aug 27 01:38:42 user nova-compute[73458]:   <devices>
Aug 27 01:38:42 user nova-compute[73458]:     <disk type="file" device="disk">
Aug 27 01:38:42 user nova-compute[73458]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 01:38:42 user nova-compute[73458]:       <source file="/opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk"/>
Aug 27 01:38:42 user nova-compute[73458]:       <target dev="vda" bus="virtio"/>
Aug 27 01:38:42 user nova-compute[73458]:     </disk>
Aug 27 01:38:42 user nova-compute[73458]:     <interface type="ethernet">
Aug 27 01:38:42 user nova-compute[73458]:       <mac address="fa:16:3e:f1:96:18"/>
Aug 27 01:38:42 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:38:42 user nova-compute[73458]:       <mtu size="1442"/>
Aug 27 01:38:42 user nova-compute[73458]:       <target dev="tap56400d7d-96"/>
Aug 27 01:38:42 user nova-compute[73458]:     </interface>
Aug 27 01:38:42 user nova-compute[73458]:     <serial type="pty">
Aug 27 01:38:42 user nova-compute[73458]:       <log file="/opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/console.log" append="off"/>
Aug 27 01:38:42 user nova-compute[73458]:     </serial>
Aug 27 01:38:42 user nova-compute[73458]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 01:38:42 user nova-compute[73458]:     <video>
Aug 27 01:38:42 user nova-compute[73458]:       <model type="virtio"/>
Aug 27 01:38:42 user nova-compute[73458]:     </video>
Aug 27 01:38:42 user nova-compute[73458]:     <rng model="virtio">
Aug 27 01:38:42 user nova-compute[73458]:       <backend model="random">/dev/urandom</backend>
Aug 27 01:38:42 user nova-compute[73458]:     </rng>
Aug 27 01:38:42 user nova-compute[73458]:     <controller type="usb" index="0" model="none"/>
Aug 27 01:38:42 user nova-compute[73458]:     <memballoon model="virtio">
Aug 27 01:38:42 user nova-compute[73458]:       <stats period="10"/>
Aug 27 01:38:42 user nova-compute[73458]:     </memballoon>
Aug 27 01:38:42 user nova-compute[73458]:   </devices>
Aug 27 01:38:42 user nova-compute[73458]: </domain>
Aug 27 01:38:42 user nova-compute[73458]:  {{(pid=73458) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913530719',display_name='tempest-SnapshotDataIntegrityTests-server-1913530719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913530719',id=53,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy5ywwrwELbkPyiMWjKFK+jOur2krd58e7+MMPWDYYGVr5hGIHyAjpGMX/pqfS49jo/y6f4UsW2f7/lTpZL78n+atVGNmoDsOG7y3hbpx2V2c9MWtE6OuHtvKl0Aysx/Q==',key_name='tempest-keypair-1526123984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1043430ec22402a9ce4354814257b0c',ramdisk_id='',reservation_id='r-apqz4w1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-298794449',owner_user_name='tempest-SnapshotDataIntegrityTests-298794449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T01:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e814e71cf1d345078ec1966ba760a82b',uuid=9bf031e0-859e-4f6c-be7f-1aabb4024028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converting VIF {"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG os_vif [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96') {{(pid=73458) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56400d7d-96, may_exist=True, interface_attrs={}) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56400d7d-96, col_values=(('external_ids', {'iface-id': '56400d7d-96d9-4482-bb9c-1f66784b5339', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:96:18', 'vm-uuid': '9bf031e0-859e-4f6c-be7f-1aabb4024028'}),), if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:42 user nova-compute[73458]: INFO os_vif [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96')
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No VIF found with MAC fa:16:3e:f1:96:18, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated VIF entry in instance network info cache for port 56400d7d-96d9-4482-bb9c-1f66784b5339. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:38:42 user nova-compute[73458]: DEBUG nova.network.neutron [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:38:43 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-a2fa6ccb-d0a9-47e5-83dd-912a84779660 req-f714d289-7302-4a3e-8969-dcb499e19fdb service nova] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:38:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG nova.compute.manager [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] No waiting events found dispatching network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:38:44 user nova-compute[73458]: WARNING nova.compute.manager [req-ba168e99-04bd-4873-bf06-af83ec503430 req-4b871e2b-160a-4ded-98f6-5bf854454c0a service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received unexpected event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 for instance with vm_state building and task_state spawning.
Aug 27 01:38:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:44 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693100326.2784567, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => Resumed> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] VM Resumed (Lifecycle Event)
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Instance event wait completed in 0 seconds for  {{(pid=73458) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Guest created on hypervisor {{(pid=73458) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Instance spawned successfully.
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_cdrom_bus of ide {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_disk_bus of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_input_bus of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_pointer_model of None {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_video_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Found default for hw_vif_model of virtio {{(pid=73458) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.virt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Emitting event <LifecycleEvent: 1693100326.2879994, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => Started> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] VM Started (Lifecycle Event)
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73458) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 27 01:38:46 user nova-compute[73458]: DEBUG nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:38:46 user nova-compute[73458]: INFO nova.compute.manager [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Took 7.11 seconds to build instance.
Aug 27 01:38:46 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-54c9d9af-a075-4b2d-94f6-6da74a5e53a1 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.235s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:38:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:38:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:38:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:38:47 user nova-compute[73458]: DEBUG nova.compute.manager [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] No waiting events found dispatching network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:38:47 user nova-compute[73458]: WARNING nova.compute.manager [req-5a8bf265-0949-4f83-a5c0-d3cb7b7d9af0 req-cd306a43-23ab-45d5-8a6e-1cb8512e0d5d service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received unexpected event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 for instance with vm_state building and task_state spawning.
Aug 27 01:38:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:38:59 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:39:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:06 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:39:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:10 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:39:10 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.21086883544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:39:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:39:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:39:15 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:39:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:22 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:39:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:39:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:39:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:39:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:01 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:40:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:40:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:08 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:09 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:10 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:40:10 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=25.198387145996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:40:10 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:40:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:40:16 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:40:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:40:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:30 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-changed-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG nova.compute.manager [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Refreshing instance network info cache due to event network-changed-56400d7d-96d9-4482-bb9c-1f66784b5339. {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Refreshing network info cache for port 56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated VIF entry in instance network info cache for port 56400d7d-96d9-4482-bb9c-1f66784b5339. {{(pid=73458) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG nova.network.neutron [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:40:31 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-bb542287-b2af-4f7b-b5c9-2fbb214f1377 req-eeaccd77-5736-4ea1-adeb-e623ad6cc0c7 service nova] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:40:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:40:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG nova.objects.instance [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:40:36 user nova-compute[73458]: INFO nova.compute.manager [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attaching volume efd3818c-acbc-4b86-a441-b7d42fa37b58 to /dev/vdb
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.utils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69e50ab-198d-4227-ab95-392582e67ce6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1e037-b269-448e-b62c-5c1738cd6894]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d4e86b-e2ec-4ada-a4a9-01ee12339073]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c26dd6-b70c-44e4-900e-d52d9817255b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:40:36 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:40:36 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a1819-8b83-4536-ab92-495f4de5d9bc]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG os_brick.utils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:40:36 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating existing volume attachment record: b362d80d-d11f-4162-bc86-c5ae72222836 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:40:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:39 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdUqERvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:40:47 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:40:47 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:40:47 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5bca05-b1e8-4668-a6a9-6e0d78f6aaca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:40:47 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce11ad61-20d4-450c-9188-560eab459005]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58] added
Aug 27 01:40:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f5663-1e19-4e12-b071-461de685880f]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1112726-bc86-4390-b861-e3de42730164]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdUqERvJ {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdUqERvJ" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b6b29-95da-4597-9b81-430ac73fe1ea]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdUqERvJ'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a21f03-5ad3-4e34-a9a5-23bf9a0e446a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e61f14-36a1-4be4-80d5-4a4877bce6c6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:40:47 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:40:47 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:40:47 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:40:47 user nova-compute[73458]: 
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f4de1-58d5-4f12-b68b-4dfa8f5fab36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260]
Aug 27 01:40:47 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260] successful.
Aug 27 01:40:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2914a0e1-18d7-47d6-a5d6-96b2af0ffe90]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc5380-fd31-4469-83b9-ce04180cb22f]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)
Aug 27 01:40:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)
Aug 27 01:40:47 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d5b85c-36f0-4fb2-b76d-a0af7a7cf677]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:40:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdUqERvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:40:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:40:48 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23834656335346333', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:40:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834656335346333', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:40:48 user nova-compute[73458]: DEBUG nova.objects.instance [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:40:48 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:40:48 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:40:48 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:40:48 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:40:48 user nova-compute[73458]:   <serial>efd3818c-acbc-4b86-a441-b7d42fa37b58</serial>
Aug 27 01:40:48 user nova-compute[73458]: </disk>
Aug 27 01:40:48 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:40:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:40:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:40:49 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No VIF found with MAC fa:16:3e:f1:96:18, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:40:49 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-acf0351a-db07-452f-a693-7fc59abc207d tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.541s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:40:49 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:54 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:40:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:41:04 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:11 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73458) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 01:41:12 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:41:12 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.196136474609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:41:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:41:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:14 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:41:17 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:41:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:41:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:41:21 user nova-compute[73458]: INFO nova.compute.manager [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Detaching volume efd3818c-acbc-4b86-a441-b7d42fa37b58
Aug 27 01:41:21 user nova-compute[73458]: INFO nova.virt.block_device [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attempting to driver detach volume efd3818c-acbc-4b86-a441-b7d42fa37b58 from mountpoint /dev/vdb
Aug 27 01:41:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Attempting to detach device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:41:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:41:21 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:41:21 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:41:21 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:41:21 user nova-compute[73458]:   <serial>efd3818c-acbc-4b86-a441-b7d42fa37b58</serial>
Aug 27 01:41:21 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:41:21 user nova-compute[73458]: </disk>
Aug 27 01:41:21 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:41:21 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config.
Aug 27 01:41:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:41:21 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:41:21 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:41:21 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:41:21 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:41:21 user nova-compute[73458]:   <serial>efd3818c-acbc-4b86-a441-b7d42fa37b58</serial>
Aug 27 01:41:21 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:41:21 user nova-compute[73458]: </disk>
Aug 27 01:41:21 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693100482.3807063, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:41:22 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config.
Aug 27 01:41:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdUqERvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:41:22 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d88e782-0db3-4161-93e0-408636a58b90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a6fd75-df66-4415-8273-80f7a3ea5e3b]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)
Aug 27 01:41:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 (non-flash)
Aug 27 01:41:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e78687400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b233668-cc07-439f-9d61-dbdc86a5f122]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62cfb7f-39cc-4c0d-938f-430ac6b39872]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d6f883-d6e4-4bf0-8f25-7a277f42e910]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb4b1a-1110-48e2-91ed-34cfb8fc43de]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4464990-1752-440b-8ab8-db21ee75df25]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a4454-8257-4934-b29a-d6f8fb3cc145]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260]
Aug 27 01:41:22 user nova-compute[73458]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58, portal: 172.16.0.220,3260] successful.
Aug 27 01:41:22 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efd3818c-acbc-4b86-a441-b7d42fa37b58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[69591774-bed9-4bd1-84ca-279d038b4aea]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== disconnect_volume: return (284ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:41:22 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:41:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:41:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-805ca16f-6a60-400e-8e32-be7f9423a850 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:41:25 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:41:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:41:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:03 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:42:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:11 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:12 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:42:12 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.195411682128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:42:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:42:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:42:15 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:42:16 user nova-compute[73458]: INFO nova.compute.manager [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attaching volume be254edd-c4f8-45cf-96c9-150dad15e53b to /dev/vdb
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.utils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f90c6-3e68-4941-a1bf-4060dca8eb39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe067c-e653-4f18-bd0c-1bd9498c7a91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06822fa-e9ad-4c45-96a4-369aa693702c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e00433-3805-4632-a19a-235d704fc31e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:42:16 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:42:16 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c0761c-0ca4-4f43-9da1-4184a5a64434]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG os_brick.utils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:42:16 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating existing volume attachment record: 2426940f-524d-427e-bdaf-10434d284c83 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:42:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:42:18 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:42:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRHkjxFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:42:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:42:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:42:26 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[86821508-1086-4da7-b6ae-f84881234d58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:42:26 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc9ee3c-661a-45b1-ab91-5171f09c16fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b] added
Aug 27 01:42:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6780b-cb54-47ab-bef0-295d2231fdcf]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5949f6-475a-437d-ad51-d76191763c1c]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRHkjxFS {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRHkjxFS" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[124472f3-3121-40a9-8f23-02aaf83c7770]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRHkjxFS'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c1e554-71fd-4c70-a2e0-f5a6b34e7751]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaae76f-05e1-4647-9a24-a7104d7c4da2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:42:26 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:42:26 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:42:26 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:42:26 user nova-compute[73458]: 
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4c825-f4ab-4a23-b839-433871b9ecb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260]
Aug 27 01:42:26 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260] successful.
Aug 27 01:42:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73409f-25bb-4f1c-9dcb-0ac604706508]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9dd2d-6320-4c11-a4ab-0834ab090306]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)
Aug 27 01:42:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)
Aug 27 01:42:26 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4a7c7-dead-4805-89ae-a2303d7d6de8]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:26 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRHkjxFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26166363035313930', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166363035313930', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:42:27 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:42:27 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:42:27 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:42:27 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:42:27 user nova-compute[73458]:   <serial>be254edd-c4f8-45cf-96c9-150dad15e53b</serial>
Aug 27 01:42:27 user nova-compute[73458]: </disk>
Aug 27 01:42:27 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:42:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:42:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:42:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No VIF found with MAC fa:16:3e:f1:96:18, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:42:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ae91eb52-6ce2-4ce9-954a-fc0903067390 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.361s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:42:29 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:42:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:42:30 user nova-compute[73458]: INFO nova.compute.manager [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Detaching volume be254edd-c4f8-45cf-96c9-150dad15e53b
Aug 27 01:42:30 user nova-compute[73458]: INFO nova.virt.block_device [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attempting to driver detach volume be254edd-c4f8-45cf-96c9-150dad15e53b from mountpoint /dev/vdb
Aug 27 01:42:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Attempting to detach device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:42:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:42:30 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:42:30 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:42:30 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:42:30 user nova-compute[73458]:   <serial>be254edd-c4f8-45cf-96c9-150dad15e53b</serial>
Aug 27 01:42:30 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:42:30 user nova-compute[73458]: </disk>
Aug 27 01:42:30 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:42:30 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config.
Aug 27 01:42:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:42:30 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:42:30 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:42:30 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:42:30 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:42:30 user nova-compute[73458]:   <serial>be254edd-c4f8-45cf-96c9-150dad15e53b</serial>
Aug 27 01:42:30 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:42:30 user nova-compute[73458]: </disk>
Aug 27 01:42:30 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693100551.4054103, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:42:31 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config.
Aug 27 01:42:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRHkjxFS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:42:31 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a3184c-096d-473f-b52e-04813c363995]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae7db53-3a15-4292-b206-edac26616bde]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)
Aug 27 01:42:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b (non-flash)
Aug 27 01:42:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1ea17d0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a6d041-1ea6-4ec1-9fbd-52aa646d0141]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b84dcc-9d2a-401e-9333-9078e20fdd16]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18d96f-b615-4996-b38b-8cc8a8a8f21d]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5c873-7057-4b86-bf6e-d6c006757d7a]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4113c4-fd53-4ed6-8a55-5462ee198bfe]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7742975-a975-430c-acdf-4086bc807679]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260]
Aug 27 01:42:31 user nova-compute[73458]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b, portal: 172.16.0.220,3260] successful.
Aug 27 01:42:31 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be254edd-c4f8-45cf-96c9-150dad15e53b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605b80b-56d8-4269-95b6-d681f9830d92]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== disconnect_volume: return (253ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:42:31 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:42:32 user nova-compute[73458]: DEBUG nova.objects.instance [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:42:32 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-a722711c-8c87-4bc9-a49a-8eeff221a102 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:42:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:34 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:42:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:42:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:42:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:01 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:05 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:05 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:43:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:43:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.19436264038086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:43:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:43:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:43:20 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:43:25 user nova-compute[73458]: INFO nova.compute.manager [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attaching volume 32d3e51e-dcc7-4558-8d10-4f84e4a80086 to /dev/vdb
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.utils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2c938-3865-4bbd-a05b-96aade208ee9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b36c5-a595-4f72-9de6-23e4187e4651]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[611c3acd-b025-4d08-8c0c-cf59fd9ce6fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bab9d1-9cb4-41c4-87c3-d4e07d50b955]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:43:25 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:43:25 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d51f51-6a57-4014-91df-c8c62a0867dc]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG os_brick.utils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:43:25 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating existing volume attachment record: c2cb4c23-45ee-4df1-a703-b81cff418185 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:43:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:29 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:43:30 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZwbofsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:43:35 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:43:35 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:43:35 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a751fc-d40a-45f8-8ac4-c47815c63ae8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:43:35 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caafb21-8502-4947-b6e0-61b3f88c4cdd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086] added
Aug 27 01:43:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e874f209-75e5-4f32-ac36-c7346a3cc607]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cfd781-45f2-44ce-b782-ca3bba34f0e6]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZwbofsx {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XZwbofsx" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d97c3e-5515-4282-b469-7a5e697fb7d0]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XZwbofsx'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ad8e7-e078-46da-b4db-2091414381f1]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb481b0-9184-4b51-8084-4c117a952815]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:43:35 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:43:35 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:43:35 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:43:35 user nova-compute[73458]: 
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55606b7-e610-4920-abd6-cc7bed0836c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260]
Aug 27 01:43:35 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260] successful.
Aug 27 01:43:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b1fc12-24c0-49f4-89ff-c36df870a059]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1095ba35-968a-47a1-8bc3-30ff6d22e178]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)
Aug 27 01:43:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)
Aug 27 01:43:35 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd566331-282d-484e-9ead-fbbcb77c822b]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:43:36 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZwbofsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23362326663353037', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362326663353037', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:43:37 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:43:37 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:43:37 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:43:37 user nova-compute[73458]:   <serial>32d3e51e-dcc7-4558-8d10-4f84e4a80086</serial>
Aug 27 01:43:37 user nova-compute[73458]: </disk>
Aug 27 01:43:37 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No VIF found with MAC fa:16:3e:f1:96:18, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ff2-d981-4b62-95e2-3a8961e2f11b tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.286s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:43:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:43:40 user nova-compute[73458]: INFO nova.compute.manager [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Detaching volume 32d3e51e-dcc7-4558-8d10-4f84e4a80086
Aug 27 01:43:40 user nova-compute[73458]: INFO nova.virt.block_device [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attempting to driver detach volume 32d3e51e-dcc7-4558-8d10-4f84e4a80086 from mountpoint /dev/vdb
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Attempting to detach device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:43:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:43:40 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:43:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:43:40 user nova-compute[73458]:   <serial>32d3e51e-dcc7-4558-8d10-4f84e4a80086</serial>
Aug 27 01:43:40 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:43:40 user nova-compute[73458]: </disk>
Aug 27 01:43:40 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:43:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config.
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:43:40 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:43:40 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:43:40 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:43:40 user nova-compute[73458]:   <serial>32d3e51e-dcc7-4558-8d10-4f84e4a80086</serial>
Aug 27 01:43:40 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:43:40 user nova-compute[73458]: </disk>
Aug 27 01:43:40 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693100620.645422, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:43:40 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config.
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XZwbofsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:43:40 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[3420b87a-6a17-4c69-9047-df37a327983e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b88fe6-4973-499c-a5e6-f58b408d53a3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)
Aug 27 01:43:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 (non-flash)
Aug 27 01:43:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e980a5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab5373-262a-4912-9904-bb6b23d962ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6969ec3-6bf4-4a54-8ed6-59ddc85c201b]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c12f1f-9146-41d3-ab53-70f945f9b6d9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20da2e8-650a-4c18-95c3-c54ca6961289]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade06f1-d246-48f1-8c7b-83b4c924aeb9]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d77919-2636-40fc-aacf-71c6b1046edf]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260]
Aug 27 01:43:40 user nova-compute[73458]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086, portal: 172.16.0.220,3260] successful.
Aug 27 01:43:40 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32d3e51e-dcc7-4558-8d10-4f84e4a80086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[738bde1e-8dd8-49b1-b0d8-c2f13cbf8ec3]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== disconnect_volume: return (257ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:43:40 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:43:41 user nova-compute[73458]: DEBUG nova.objects.instance [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:43:41 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-ff8fb7b8-6283-4dac-b26e-0f31abb6e3b8 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.640s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:43:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:45 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:43:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:13 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:44:14 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.19336700439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:44:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:44:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:44:21 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:44:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:44:35 user nova-compute[73458]: INFO nova.compute.manager [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attaching volume d97f0953-2c35-4508-b59c-3a7e99079c63 to /dev/vdb
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.utils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f59bcae-b91e-4a86-81ad-f9c31da6d18b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:749ffd4e9646\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142c858-d625-4706-aa5e-3fd19e392bc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[681cc498-d6fc-412e-89f4-5bc0f8c587e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde56f39-3d1a-440c-ad18-6894ede2794a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Running cmd (subprocess): nvme version {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] 'nvme version' failed. Not Retrying. {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] nvme not present on system {{(pid=73458) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 01:44:35 user nova-compute[73458]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 01:44:35 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a5b3e4-a606-465a-92d5-45d69357af15]: (4, '') {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73458) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.lightos [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] LIGHTOS: no hostnqn found. {{(pid=73458) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG os_brick.utils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:749ffd4e9646', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:44:35 user nova-compute[73458]: DEBUG nova.virt.block_device [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating existing volume attachment record: 6c3371b8-a80b-4a23-be0f-a5958dd50c10 {{(pid=73458) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 01:44:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:40 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Calling os-brick to attach iSCSI Volume {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCTWKAqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:44:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:44:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:44:45 user nova-compute[73458]: INFO os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[de41f19c-4267-42ff-97ba-0bfcdaeb64b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 01:44:45 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --interface default --op new {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74f529-890a-4fdf-81b9-45d190128a76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63] added\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63] added
Aug 27 01:44:45 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64dc35d-2067-4f1a-9c82-ad12859cd17a]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ff7686-6cbd-4626-87f3-56a043d53037]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCTWKAqH {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCTWKAqH" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[28570364-5fbe-4600-8963-f5d05451c2cb]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCTWKAqH'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707bbba-47ed-41a9-848c-2294590654ab]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb703a-5583-4a90-813e-35c37f02356a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:44:45 user nova-compute[73458]:  {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:44:45 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 01:44:45 user nova-compute[73458]:  {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:44:45 user nova-compute[73458]: WARNING os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 01:44:45 user nova-compute[73458]: 
Aug 27 01:44:45 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --login {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6269cf-7448-4ffe-9d0d-794af0f7b2a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260]
Aug 27 01:44:46 user nova-compute[73458]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260] successful.
Aug 27 01:44:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[acce5d01-8c69-4d5d-9926-a7fdbe6d3f26]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d675f54-214d-4b17-bb19-589eb01ad807]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)
Aug 27 01:44:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)
Aug 27 01:44:46 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to 172.16.0.220:3260 {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73458) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73458) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ca3c72-bedc-4a0b-a547-88b114587498]: (4, ('- - 0', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:46 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73458) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCTWKAqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73458) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26261663730316634', 'path': '/dev/sdb'} {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261663730316634', 'path': '/dev/sdb'} {{(pid=73458) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.objects.instance [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 01:44:47 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:44:47 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:44:47 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:44:47 user nova-compute[73458]:   <serial>d97f0953-2c35-4508-b59c-3a7e99079c63</serial>
Aug 27 01:44:47 user nova-compute[73458]: </disk>
Aug 27 01:44:47 user nova-compute[73458]:  {{(pid=73458) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vda, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73458) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] No VIF found with MAC fa:16:3e:f1:96:18, not building metadata {{(pid=73458) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-6be5f1b5-cf1f-4c91-913e-187b124701f9 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.208s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:44:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:44:50 user nova-compute[73458]: INFO nova.compute.manager [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Detaching volume d97f0953-2c35-4508-b59c-3a7e99079c63
Aug 27 01:44:50 user nova-compute[73458]: INFO nova.virt.block_device [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Attempting to driver detach volume d97f0953-2c35-4508-b59c-3a7e99079c63 from mountpoint /dev/vdb
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Attempting to detach device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config. {{(pid=73458) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:44:50 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:44:50 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:44:50 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:44:50 user nova-compute[73458]:   <serial>d97f0953-2c35-4508-b59c-3a7e99079c63</serial>
Aug 27 01:44:50 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:44:50 user nova-compute[73458]: </disk>
Aug 27 01:44:50 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:44:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the persistent domain config.
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config. {{(pid=73458) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.guest [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 01:44:50 user nova-compute[73458]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 01:44:50 user nova-compute[73458]:   <source dev="/dev/sdb"/>
Aug 27 01:44:50 user nova-compute[73458]:   <target dev="vdb" bus="virtio"/>
Aug 27 01:44:50 user nova-compute[73458]:   <serial>d97f0953-2c35-4508-b59c-3a7e99079c63</serial>
Aug 27 01:44:50 user nova-compute[73458]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 01:44:50 user nova-compute[73458]: </disk>
Aug 27 01:44:50 user nova-compute[73458]:  {{(pid=73458) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-450dbeab-d12c-4094-b7c6-89cbeffd0fda None None] Received event <DeviceRemovedEvent: 1693100690.6377356, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73458) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.driver [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 01:44:50 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully detached device vdb from instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 from the live domain config.
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] calling os-brick to detach iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e982ab4f0>, {'target_iqns': ['iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCTWKAqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 01:44:50 user nova-compute[73458]: WARNING os_brick.initiator.connectors.base [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63', 0)] {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee069c59-f510-4c7a-bd00-c87030af7d8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51dc08-650c-4084-93c0-9b22b62cd3a1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)
Aug 27 01:44:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 (non-flash)
Aug 27 01:44:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e7838f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63'): ({'sdb'}, set())}) {{(pid=73458) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Removing single pathed devices sdb {{(pid=73458) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dbf1ab-efab-4be0-bb21-6c835b391ab4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc4fb87-4710-46e9-88e2-1e8fc72da84b]: (4, ('ok\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Flushing IO for device /dev/sdb {{(pid=73458) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[01738af3-71e7-4974-a466-fc758c4267ca]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73458) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d6ffab-76ca-47b2-89c9-f45e42d35613]: (4, ('1', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.linuxscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] SCSI volumes sdb have been removed. {{(pid=73458) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63')] {{(pid=73458) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ffea1-0287-47fb-a4c9-61c5f27a7499]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --logout {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08c6fe0-dce8-4272-843a-b6dfb38e911b]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260]
Aug 27 01:44:50 user nova-compute[73458]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63, portal: 172.16.0.220,3260] successful.
Aug 27 01:44:50 user nova-compute[73458]:  stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op delete {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97f0953-2c35-4508-b59c-3a7e99079c63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84129) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b540747-e8a5-4187-accd-39dc990b1257]: (4, ('', '')) {{(pid=84129) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73458) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.base [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG os_brick.initiator.connectors.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] <== disconnect_volume: return (261ms) None {{(pid=73458) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 01:44:50 user nova-compute[73458]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Disconnected iSCSI Volume {{(pid=73458) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 01:44:51 user nova-compute[73458]: DEBUG nova.objects.instance [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'flavor' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:44:51 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-543aff77-91f1-4e76-8af7-b34fc5efdc64 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:44:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:55 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:44:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:08 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:09 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:09 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:45:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:45:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:45:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=25.192325592041016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:45:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:45:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:18 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:45:23 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:45:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:45:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:45:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:45:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:28 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:28 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances with incomplete migration  {{(pid=73458) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 01:45:32 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:32 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:37 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:40 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:42 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:47 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:52 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:55 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_power_states {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:55 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Triggering sync for uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 01:45:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:45:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:45:55 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:45:56 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:45:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Cleaning up deleted instances {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 01:45:56 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] There are 0 instances to clean {{(pid=73458) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:45:57 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:02 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:03 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:07 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:10 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:11 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:46:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:12 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:13 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 01:46:14 user nova-compute[73458]: DEBUG oslo_concurrency.processutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73458) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 01:46:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:46:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.18362808227539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Instance 9bf031e0-859e-4f6c-be7f-1aabb4024028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73458) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing inventories for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating ProviderTree inventory for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Updating inventory in ProviderTree for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing aggregate associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, aggregates: None {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Refreshing trait associations for resource provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV {{(pid=73458) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:46:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:46:17 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:22 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquired lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Forcefully refreshing network info cache for instance {{(pid=73458) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.objects.instance [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lazy-loading 'info_cache' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.network.neutron [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [{"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Releasing lock "refresh_cache-9bf031e0-859e-4f6c-be7f-1aabb4024028" {{(pid=73458) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 01:46:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updated the network info_cache for instance {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:27 user nova-compute[73458]: INFO nova.compute.manager [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Terminating instance
Aug 27 01:46:27 user nova-compute[73458]: DEBUG nova.compute.manager [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Start destroying the instance on the hypervisor. {{(pid=73458) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:27 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-unplugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] No waiting events found dispatching network-vif-unplugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.compute.manager [req-17c0ce04-df35-4912-9940-3d8bce09bec6 req-97827ebe-d1af-4323-b8fe-e8dc05786fef service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-unplugged-56400d7d-96d9-4482-bb9c-1f66784b5339 for instance with task_state deleting. {{(pid=73458) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Instance destroyed successfully.
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.objects.instance [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lazy-loading 'resources' on Instance uuid 9bf031e0-859e-4f6c-be7f-1aabb4024028 {{(pid=73458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.virt.libvirt.vif [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T01:38:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1913530719',display_name='tempest-SnapshotDataIntegrityTests-server-1913530719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1913530719',id=53,image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy5ywwrwELbkPyiMWjKFK+jOur2krd58e7+MMPWDYYGVr5hGIHyAjpGMX/pqfS49jo/y6f4UsW2f7/lTpZL78n+atVGNmoDsOG7y3hbpx2V2c9MWtE6OuHtvKl0Aysx/Q==',key_name='tempest-keypair-1526123984',keypairs=<?>,launch_index=0,launched_at=2023-08-27T01:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1043430ec22402a9ce4354814257b0c',ramdisk_id='',reservation_id='r-apqz4w1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8d38b8b6-6075-47a6-bfce-08caf5b910c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-298794449',owner_user_name='tempest-SnapshotDataIntegrityTests-298794449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T01:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e814e71cf1d345078ec1966ba760a82b',uuid=9bf031e0-859e-4f6c-be7f-1aabb4024028,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converting VIF {"id": "56400d7d-96d9-4482-bb9c-1f66784b5339", "address": "fa:16:3e:f1:96:18", "network": {"id": "d26a1971-27ad-4168-b91d-e305c2e3c440", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-566804806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1043430ec22402a9ce4354814257b0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56400d7d-96", "ovs_interfaceid": "56400d7d-96d9-4482-bb9c-1f66784b5339", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.network.os_vif_util [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96') {{(pid=73458) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG os_vif [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96') {{(pid=73458) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56400d7d-96, bridge=br-int, if_exists=True) {{(pid=73458) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:28 user nova-compute[73458]: INFO os_vif [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:96:18,bridge_name='br-int',has_traffic_filtering=True,id=56400d7d-96d9-4482-bb9c-1f66784b5339,network=Network(d26a1971-27ad-4168-b91d-e305c2e3c440),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56400d7d-96')
Aug 27 01:46:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Deleting instance files /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028_del
Aug 27 01:46:28 user nova-compute[73458]: INFO nova.virt.libvirt.driver [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Deletion of /opt/stack/data/nova/instances/9bf031e0-859e-4f6c-be7f-1aabb4024028_del complete
Aug 27 01:46:28 user nova-compute[73458]: INFO nova.compute.manager [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 27 01:46:28 user nova-compute[73458]: DEBUG oslo.service.loopingcall [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73458) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.compute.manager [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Deallocating network for instance {{(pid=73458) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 01:46:28 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] deallocate_for_instance() {{(pid=73458) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 01:46:29 user nova-compute[73458]: DEBUG nova.network.neutron [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Updating instance_info_cache with network_info: [] {{(pid=73458) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 01:46:29 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Took 0.79 seconds to deallocate network for instance.
Aug 27 01:46:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:29 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:46:29 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:46:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:29 user nova-compute[73458]: INFO nova.scheduler.client.report [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Deleted allocations for instance 9bf031e0-859e-4f6c-be7f-1aabb4024028
Aug 27 01:46:29 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-486a4cfb-9cf3-40e4-9dab-2925a6101862 tempest-SnapshotDataIntegrityTests-298794449 tempest-SnapshotDataIntegrityTests-298794449-project-member] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:46:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] Acquiring lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:46:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:46:30 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] Lock "9bf031e0-859e-4f6c-be7f-1aabb4024028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:46:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] No waiting events found dispatching network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 01:46:30 user nova-compute[73458]: WARNING nova.compute.manager [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received unexpected event network-vif-plugged-56400d7d-96d9-4482-bb9c-1f66784b5339 for instance with vm_state deleted and task_state None.
Aug 27 01:46:30 user nova-compute[73458]: DEBUG nova.compute.manager [req-0d9f3fe3-61bd-42b5-a31e-9108f978d6b3 req-c2a57439-756b-4b2f-b604-a4564deb8c2e service nova] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Received event network-vif-deleted-56400d7d-96d9-4482-bb9c-1f66784b5339 {{(pid=73458) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 01:46:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:46:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:43 user nova-compute[73458]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693100788.497224, 9bf031e0-859e-4f6c-be7f-1aabb4024028 => Stopped> {{(pid=73458) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 01:46:43 user nova-compute[73458]: INFO nova.compute.manager [-] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] VM Stopped (Lifecycle Event)
Aug 27 01:46:43 user nova-compute[73458]: DEBUG nova.compute.manager [None req-3124f51f-a5bd-404c-98d0-c659aee449b4 None None] [instance: 9bf031e0-859e-4f6c-be7f-1aabb4024028] Checking state {{(pid=73458) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 01:46:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:48 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:53 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:46:58 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:03 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:04 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:08 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:47:11 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:12 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:12 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73458) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 01:47:13 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager.update_available_resource {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Auditing locally available compute resources for user (node: user) {{(pid=73458) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 01:47:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:47:15 user nova-compute[73458]: WARNING nova.virt.libvirt.driver [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.203197479248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73458) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73458) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.provider_tree [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed in ProviderTree for provider: 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 {{(pid=73458) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.scheduler.client.report [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Inventory has not changed for provider 3dbe5db4-8c3d-4097-8fbe-32da614b3f79 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73458) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG nova.compute.resource_tracker [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Compute_service record updated for user:user {{(pid=73458) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 01:47:15 user nova-compute[73458]: DEBUG oslo_concurrency.lockutils [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73458) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 01:47:16 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:17 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:18 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:19 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:21 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:23 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:24 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Starting heal instance info cache {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 01:47:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Rebuilding the list of instances to heal {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 01:47:24 user nova-compute[73458]: DEBUG nova.compute.manager [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Didn't find any instances for network info cache update. {{(pid=73458) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 01:47:25 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:28 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:33 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:35 user nova-compute[73458]: DEBUG oslo_service.periodic_task [None req-42fd1989-1cb8-4e9b-a15b-e39b7a74b17a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73458) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 01:47:38 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73458) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73458) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 01:47:43 user nova-compute[73458]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73458) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}